-- Logs begin at Tue 2022-05-31 19:57:59 UTC, end at Tue 2022-05-31 21:27:16 UTC. -- May 31 20:54:16.415645 dv-cinder-839793-16-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 31 20:54:16.424386 dv-cinder-839793-16-iscsi devstack@n-api.service[103578]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 31 20:54:16.426604 dv-cinder-839793-16-iscsi devstack@n-api.service[103578]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 31 20:54:16 2022] *** May 31 20:54:16.426604 dv-cinder-839793-16-iscsi devstack@n-api.service[103578]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 31 20:54:16.426604 dv-cinder-839793-16-iscsi devstack@n-api.service[103578]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 31 20:54:16.426604 dv-cinder-839793-16-iscsi devstack@n-api.service[103578]: nodename: dv-cinder-839793-16-iscsi May 31 20:54:16.426604 dv-cinder-839793-16-iscsi devstack@n-api.service[103578]: machine: x86_64 May 31 20:54:16.426604 dv-cinder-839793-16-iscsi devstack@n-api.service[103578]: clock source: unix May 31 20:54:16.426604 dv-cinder-839793-16-iscsi devstack@n-api.service[103578]: pcre jit disabled May 31 20:54:16.426604 dv-cinder-839793-16-iscsi devstack@n-api.service[103578]: detected number of CPU cores: 4 May 31 20:54:16.426604 dv-cinder-839793-16-iscsi devstack@n-api.service[103578]: current working directory: / May 31 20:54:16.426604 dv-cinder-839793-16-iscsi devstack@n-api.service[103578]: detected binary path: /usr/bin/uwsgi-core May 31 20:54:16.427333 dv-cinder-839793-16-iscsi devstack@n-api.service[103578]: your processes number limit is 47680 May 31 20:54:16.427333 dv-cinder-839793-16-iscsi devstack@n-api.service[103578]: your memory page size is 4096 bytes May 31 20:54:16.427333 dv-cinder-839793-16-iscsi devstack@n-api.service[103578]: detected max file descriptor number: 2048 May 31 20:54:16.427333 dv-cinder-839793-16-iscsi devstack@n-api.service[103578]: lock engine: pthread robust mutexes May 31 20:54:16.427333 dv-cinder-839793-16-iscsi devstack@n-api.service[103578]: thunder lock: enabled May 31 20:54:16.427333 dv-cinder-839793-16-iscsi devstack@n-api.service[103578]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 31 20:54:16.427333 dv-cinder-839793-16-iscsi devstack@n-api.service[103578]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 31 20:54:16.471760 dv-cinder-839793-16-iscsi devstack@n-api.service[103578]: Python main interpreter initialized at 0x55b81b5749c0 May 31 20:54:16.471760 dv-cinder-839793-16-iscsi devstack@n-api.service[103578]: python threads support enabled May 31 20:54:16.471760 dv-cinder-839793-16-iscsi devstack@n-api.service[103578]: your server socket listen backlog is limited to 100 connections May 31 20:54:16.471760 dv-cinder-839793-16-iscsi devstack@n-api.service[103578]: your mercy for graceful operations on workers is 90 seconds May 31 20:54:16.472158 dv-cinder-839793-16-iscsi devstack@n-api.service[103578]: mapped 403077 bytes (393 KB) for 2 cores May 31 20:54:16.472158 dv-cinder-839793-16-iscsi devstack@n-api.service[103578]: *** Operational MODE: preforking *** May 31 20:54:16.472436 dv-cinder-839793-16-iscsi devstack@n-api.service[103578]: *** uWSGI is running in multiple interpreter mode *** May 31 20:54:16.472436 dv-cinder-839793-16-iscsi devstack@n-api.service[103578]: spawned uWSGI master process (pid: 103578) May 31 20:54:16.472641 dv-cinder-839793-16-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 31 20:54:16.474649 dv-cinder-839793-16-iscsi devstack@n-api.service[103578]: spawned uWSGI worker 1 (pid: 103579, cores: 1) May 31 20:54:16.474649 dv-cinder-839793-16-iscsi devstack@n-api.service[103578]: spawned uWSGI worker 2 (pid: 103580, cores: 1) May 31 20:54:16.474649 dv-cinder-839793-16-iscsi devstack@n-api.service[103578]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 31 20:54:17.695929 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 31 20:54:17.696539 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 31 20:54:18.411342 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 31 20:54:18.411342 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: from cryptography.utils import int_from_bytes May 31 20:54:18.411644 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 31 20:54:18.411644 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: from cryptography.utils import int_from_bytes May 31 20:54:18.411797 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 31 20:54:18.411797 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: from cryptography.utils import int_from_bytes May 31 20:54:18.411932 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 31 20:54:18.411932 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: from cryptography.utils import int_from_bytes May 31 20:54:21.045825 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 31 20:54:21.046400 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 31 20:54:21.046745 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 31 20:54:21.046839 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 31 20:54:21.046930 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 31 20:54:21.047016 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 31 20:54:21.047092 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 31 20:54:21.047166 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 31 20:54:21.047232 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 31 20:54:21.047296 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 31 20:54:21.047456 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.047625 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.047779 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.047946 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.048094 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.048270 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.048407 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.048591 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.048731 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.048923 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.049020 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.049235 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.049320 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.049557 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.049651 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.049878 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.050011 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.050206 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.050297 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.050477 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.050572 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.050792 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.050878 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839793-16-iscsi {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.051117 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839793-16-iscsi {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.051202 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.051417 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.051509 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.051723 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.051815 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.052581 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.052678 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.052907 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.052993 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.053215 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.053300 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.053538 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.053623 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.053846 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.054053 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.054384 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.054533 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.054697 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.054817 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.055002 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.055131 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.055326 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.055465 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.055650 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.055736 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.055965 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.056060 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.056274 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.056367 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.056573 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.056657 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.056888 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.057017 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.057192 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.057276 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.057501 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.057588 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839793-16-iscsi {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.057886 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.058001 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839793-16-iscsi {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.058216 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.058302 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.058527 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.058662 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.058841 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.058933 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.059225 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.059311 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.059530 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.059615 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.059842 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.059929 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.060155 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.060238 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.060458 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.060559 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.060764 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.060848 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.061076 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.061161 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.061389 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.061486 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.061702 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.061793 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.062021 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.062111 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.062329 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.062443 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.062632 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.062724 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.062942 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.063027 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.063259 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.063356 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.063564 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.063649 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.063807 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.063890 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.064105 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.064196 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.064413 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.064509 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.064722 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.064815 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.065036 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.065125 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.065283 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.065383 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.065538 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.065683 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.065834 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.065945 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.066171 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.066258 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.066473 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.066559 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.066774 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.066860 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.067077 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.067162 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.067375 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.067468 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.067710 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.067808 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.068014 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.068106 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.068315 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.068402 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.068616 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.068700 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.068924 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.069015 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.069231 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.069316 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.069542 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.069625 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.069839 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.069970 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.070179 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.070265 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.070493 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.070577 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.55 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.070799 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.55 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.070894 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.55 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.071102 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.071194 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.55 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.071414 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.071505 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.071730 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.071822 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.072031 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.072124 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.072344 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.072428 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.072641 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.072730 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.072943 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.073027 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.073243 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.073327 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.073545 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.073629 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.073845 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.073952 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.074185 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.074269 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.074488 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.074604 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.074737 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.074836 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.075029 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.075112 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.075325 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.075410 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.075635 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.075732 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.075932 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.076023 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.076232 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.076331 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.076532 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.076632 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.076828 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.076920 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.077125 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.077215 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.077421 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.077521 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.077723 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.077824 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.078046 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.078150 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.078345 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.078448 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.078644 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.078745 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.078945 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.079037 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.079245 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.079345 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.079544 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.079645 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.079849 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.079939 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.080157 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.080255 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.080458 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.080564 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.080757 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.080856 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.081059 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.081149 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.081357 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.081455 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.081658 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.081761 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.081979 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.082071 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.082281 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.082381 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.082586 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.082710 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.082884 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.082974 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.083695 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.083814 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.084021 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.084122 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.084318 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.084405 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.084621 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.084727 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.084925 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.085011 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.085218 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.085304 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.085520 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.085608 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.085830 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.085937 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.086157 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.086256 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.086484 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.086589 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.086759 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.086882 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.087062 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.087146 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.087359 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.087471 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.087663 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.087750 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.087962 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.088046 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.088263 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.088349 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.088556 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.088647 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.088855 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.088948 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.089167 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.089251 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.089470 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.089554 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.089772 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.089870 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.090098 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.090185 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.090401 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.090487 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.090720 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:54:21.090814 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.091046 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.091129 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.091374 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.091459 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.091679 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.091771 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.092005 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.092098 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.092332 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.092417 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.092643 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.092735 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.092952 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.093037 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.093262 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.093355 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.093574 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.093659 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.093877 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.093981 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.094208 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.094297 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.094517 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.094613 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.094830 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.094916 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.095142 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.095235 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.095459 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.095557 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.095769 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.095907 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.096081 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.096175 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.096395 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.096489 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.096703 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.096796 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.097012 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.097097 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.097331 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.097417 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.097653 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.097739 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.097983 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.098086 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.098298 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.098383 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.098640 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.098725 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.099520 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.099626 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.099846 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.099946 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.100163 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.100256 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.100471 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.100569 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.100778 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.100864 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.101087 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.101172 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.101398 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.101496 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.101723 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.101816 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.102051 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.102137 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.102367 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.102454 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.102673 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.102759 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.102982 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.103068 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.103291 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.103378 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.103597 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.103681 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.103899 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.103992 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.104206 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.104300 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.104525 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.104614 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.104837 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.104923 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.105145 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.105231 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.105454 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.105537 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.105757 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.105850 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.106089 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.106176 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.106396 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.106491 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.106695 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.106789 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.107248 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.107345 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.107553 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.107645 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.107855 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.107948 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.108155 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.108249 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.108456 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.108540 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.108778 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.108879 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.109078 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.109163 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.109391 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.109477 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.109691 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.109788 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.110019 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.110109 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.110327 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.110425 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.110634 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.110728 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.110937 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.111030 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.111239 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.111331 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.111555 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.111755 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.111891 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.111974 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.112143 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.112235 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.112446 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.112532 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.112765 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.112852 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.113051 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.113135 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.113355 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.113442 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.113655 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.113747 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.113979 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.114089 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.114290 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.114383 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.114621 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.114706 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.114927 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.115026 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.115234 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.115318 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.115545 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.115641 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.115851 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.115949 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.116158 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.116244 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.116468 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.116561 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.116797 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.116883 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.117098 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.117184 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.117415 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.117499 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.117732 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.117818 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.118067 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.118157 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.118368 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.118452 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.118674 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.118761 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.118972 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.119058 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.119272 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.119357 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.119571 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.119738 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.119871 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.119956 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.120167 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.120260 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.120467 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.120553 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.120768 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.120854 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.121067 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.121161 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.121365 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.121461 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.121666 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.121750 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.121998 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.122098 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.122299 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.122385 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.122600 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.122684 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.122897 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.122996 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.123197 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.123290 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.123521 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.123606 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.123831 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.123925 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.124172 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.124258 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.124482 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.124573 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.124800 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.124887 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.125111 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.125197 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.125418 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.125503 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.125723 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.125808 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.126059 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.126149 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.126370 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.126457 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.126674 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.126760 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.126981 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.127074 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.127285 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.127370 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.127595 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.127680 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.127902 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.128038 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.128212 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.128313 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.128519 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.128611 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.128831 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.128916 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.129131 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.129229 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.129440 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.129532 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.129754 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.129840 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.130132 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.130234 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.130447 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.130533 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.130764 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.130851 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.131069 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.131162 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.131377 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.131469 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.131681 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.131765 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.131987 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.132074 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.132293 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.132378 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.132599 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.132692 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.132913 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.132999 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.133219 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.133311 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.133531 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.133616 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.133838 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.133937 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.134229 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.134325 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.134542 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.134633 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.134851 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.134936 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.135149 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.135240 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.135460 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.135551 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.135780 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.135865 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.136105 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.136196 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.136409 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.136506 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.136717 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.136813 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.137027 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.137110 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.137331 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.137422 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.137640 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.137725 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.137975 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.138097 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.138278 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.138371 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.138581 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.138674 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.138885 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.138976 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.139194 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.139287 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.139498 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.139582 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.139803 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.139888 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.140103 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.140197 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.140405 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.140490 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.140708 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.140801 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.141010 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.141104 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.141313 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.141396 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.141617 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.141708 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.141946 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.142034 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.142262 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.142346 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.142568 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.142663 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.142884 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.142976 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.143184 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.143271 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.143484 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.143577 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.143786 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.143871 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.144092 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.144178 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.144392 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.144485 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.144692 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.144776 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.144987 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.145072 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.145287 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.145383 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.145612 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.146251 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.146476 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.146561 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.146789 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.146885 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.147103 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.147188 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.147410 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.147502 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.147718 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.147815 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.148031 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.148123 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.148338 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.148474 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.148644 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.148729 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.148948 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.149031 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.149251 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.149336 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.149556 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.149642 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.149857 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.149962 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.150184 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.150271 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.150490 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.150584 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.150797 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.150891 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.151098 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.151190 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.151402 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.151487 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.151705 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.151791 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.152003 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.152097 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.152303 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.152387 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.152611 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.152696 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.152925 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.153172 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.153486 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.153580 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.153799 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.153882 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.154137 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.154235 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.154456 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.154542 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.154768 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.154860 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.155084 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.155170 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.155402 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.155486 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.155727 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.155810 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.156030 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.156123 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.156337 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.156439 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.156637 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.156723 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.156937 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.157022 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.157243 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.157343 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.157541 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.157633 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.157843 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.157957 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.158172 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.158258 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.158478 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.158609 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.158777 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.158864 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.159078 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.159172 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.159373 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.159458 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.159673 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.159758 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.159976 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.160061 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.160273 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.160364 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.160577 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.160662 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.160872 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.160957 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.161177 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.161263 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.162054 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.162151 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.162358 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.162453 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.162660 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.162754 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.162960 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.163053 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.163261 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.163345 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.163582 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.163673 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.163897 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.163991 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.164217 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.164301 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.164572 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.164851 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.164982 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.165151 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.165330 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.165468 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.165641 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.165767 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.165972 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.166124 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.166308 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.166394 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.166617 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.166702 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.166926 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.167119 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.167219 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.167287 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.167530 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.167617 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.167840 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.167935 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.168145 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.168231 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.168447 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.168532 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.168749 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.168835 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.169057 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.169142 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.169357 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.169451 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.169658 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.169744 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.169987 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.170078 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.170290 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.170394 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.170587 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.170682 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.170891 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.170977 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.171193 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.171286 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.171487 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.171572 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.171790 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.171876 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.172088 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.172187 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.172390 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.172475 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.172684 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.172777 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.172982 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.173068 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.173281 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.173367 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.173585 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.173677 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.173886 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.173989 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.174205 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.174290 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.174512 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.174598 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.174814 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.174900 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.175115 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.175200 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.175415 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.175500 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.175720 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.175806 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.176018 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.176105 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.176319 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.176413 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.176625 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.176710 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.176950 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.177035 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.177288 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.177453 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.177565 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.177651 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.177994 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.178105 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.178193 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.178281 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.178483 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.178579 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.178784 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.178870 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.179088 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.179188 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.179385 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.179472 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.179684 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.179779 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.179982 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.180069 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.180281 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.180367 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.180579 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.180672 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.180880 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.180967 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.181184 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.181270 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.181485 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.181569 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.181783 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.181876 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.182107 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.182195 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.182421 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.182505 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.182728 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.182814 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.183028 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.183120 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.183366 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.183463 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.183672 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.183758 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.183984 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.184068 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.184290 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.184384 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.184595 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.184681 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.184902 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.184988 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.185200 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.185295 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.185509 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.185602 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.185812 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.185921 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.186145 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.186242 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.186443 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.186526 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.186742 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.186829 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.187056 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.187149 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.187355 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.187440 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.187656 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.187747 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.187974 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.188060 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.188286 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.188371 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.188596 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.188681 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.188895 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.188970 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.189200 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.189286 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.189506 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.189598 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.189809 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.189939 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.190136 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.190223 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.190442 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.190538 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.190774 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.190878 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.191051 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.191136 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.191357 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.191462 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.191662 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.191761 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.191963 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.192070 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.192260 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.192355 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.192582 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.192669 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.192888 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.192974 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.193188 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.193286 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.193495 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.193588 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.193796 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.193887 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.194120 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.194219 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.194425 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.194510 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.194723 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.194815 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.195024 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.195118 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.195321 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.195406 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.195621 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.195743 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.195929 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.196051 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.196240 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.196356 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.196655 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.196743 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.196959 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.197052 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.197264 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.197350 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.197566 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.197650 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.197877 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.197994 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.198196 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.198282 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.198515 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.198610 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.198832 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.198918 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.199139 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.199224 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.199478 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.199560 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.199776 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.199850 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.200072 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.200158 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.200374 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.200467 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.200689 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.200814 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.201018 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.201110 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.201319 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.201412 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.201617 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.201728 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.201951 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.202053 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.202253 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.202340 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.202567 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.202653 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.202946 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.203032 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.203252 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.203339 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.203548 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.203640 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.203951 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.204044 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.204254 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.204342 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.204556 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.204640 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.204866 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.204957 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.205178 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.205265 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.205493 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.205579 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.205791 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.206058 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.206147 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.206225 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.206410 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.206506 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.206727 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.206823 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.207044 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.207138 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.207346 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.207432 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.207653 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.207738 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.207956 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.208049 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.208802 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.208899 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.209116 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.209248 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.209422 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.209522 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.209735 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.209829 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.210080 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.210167 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.210395 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.210499 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.210717 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.210804 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.211064 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.211148 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.211383 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.211480 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.211700 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.211795 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.211984 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.212072 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.212287 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.212374 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.212586 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.212672 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.212885 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.212970 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.213199 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.213294 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.213496 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.213582 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.213799 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.213918 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.214137 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.214233 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.214440 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.214525 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.214735 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.214833 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.215032 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.215119 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.215339 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.215425 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.215635 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.215733 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.215935 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.216029 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.216240 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.216325 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.216553 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.216710 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.216867 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.216961 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.217166 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.217253 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.217479 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.217578 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.217782 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.217877 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.218103 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.218192 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.218407 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.218494 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.218705 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.218797 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.219008 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.219093 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.219315 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.219410 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.219621 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.219706 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.219940 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.220034 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.220249 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.220335 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.220555 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.220640 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.220881 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.220975 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.221204 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.221293 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.221511 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.221603 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.221820 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.221939 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.222164 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.222252 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.222467 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.222556 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.222766 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.222861 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.223071 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.223158 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.223370 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.223456 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.223670 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.223765 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.224528 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.224623 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.224833 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.224932 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.225128 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.225225 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.225427 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.225513 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.225725 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.225811 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.226051 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.226138 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.226352 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.226438 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.226661 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.226747 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.226962 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.227055 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.227261 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.227346 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.227559 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.227644 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.227857 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.227944 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.228161 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.228246 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.228468 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.228553 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.228771 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.228858 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.229093 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.229187 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.229402 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.229495 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.229721 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.229805 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.230083 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.230209 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.230406 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.230529 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.230730 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.230815 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.231036 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.231128 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.231344 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.231437 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.231654 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.231740 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.232219 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.232320 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.232530 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.232628 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.232838 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.232931 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.233143 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.233237 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.233456 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.233543 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.233765 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.233851 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.234100 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.234188 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.234479 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.234635 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.234793 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.234965 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.235111 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.235281 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.235596 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.235682 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.235908 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.235994 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.236220 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.236314 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.236532 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.236619 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.236844 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.236931 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.237156 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.237249 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.237462 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.237547 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.237768 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.237854 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.238105 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.238205 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.238418 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.238505 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.238729 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.238816 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.239056 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.239151 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.239368 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.239527 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.239707 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.239794 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.240021 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.240108 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.240333 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.240426 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.240646 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.240738 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.240961 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.241048 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.241268 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.241353 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.241579 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.241673 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.241903 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.242007 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.242216 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.242302 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.242522 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.242618 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.242826 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.242913 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.243135 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.243232 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.243442 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.243530 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.243747 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.243832 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.244053 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.244140 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.244361 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.244448 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.244667 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.244758 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.244976 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.245061 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.245291 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.245379 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.245604 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.245689 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.245931 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.246099 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.246244 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.246332 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.246553 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.246648 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.246877 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.247062 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.247190 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.247372 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.247504 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.247699 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.248019 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.248113 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.248334 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.248420 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.248646 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.248737 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.248961 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.249057 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.249282 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.249369 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.249583 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.249669 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.249884 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.250020 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.250211 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.250308 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.250517 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.250610 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.250817 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.250904 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.251123 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.251208 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.251424 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.251515 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.251722 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.251809 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.252038 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.252123 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.252341 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.252425 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.252641 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.252865 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.252952 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.253212 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.253298 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.253524 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.253771 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.253865 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.254154 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.254242 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.254473 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.254575 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.254776 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.254862 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.255126 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.255220 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.255430 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.255526 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.255732 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.255818 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.256043 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.256130 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.256347 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.256433 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.256646 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.256737 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.256948 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.257035 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.257256 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.257343 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.257558 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.257643 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.257855 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.257959 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.258186 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.258275 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.258486 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.258575 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.258787 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.258879 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.259091 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.259178 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.259391 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.259476 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.259688 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.259783 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.260003 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.260096 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.260310 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.260396 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.260614 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.260709 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.260911 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.260995 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.261209 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.261295 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.261509 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.261603 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.261805 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.261941 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.262131 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.262217 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.262430 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.262526 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.262735 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.262821 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.263034 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.263119 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.263338 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.263434 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.263672 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.263757 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.263976 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.264062 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.264274 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.264367 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.264572 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.264658 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.264881 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.264967 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.265186 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.265273 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.265500 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.265586 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.265806 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.265909 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.266134 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.266223 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.266459 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.266556 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.266770 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.266856 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.267079 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.267299 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.267423 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.267632 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.267766 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.267954 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.268257 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.268349 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.268590 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.268685 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.268904 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.268997 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.269208 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.269301 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.269512 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.269603 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.269833 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.269950 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.270165 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.270251 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.270470 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.270556 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.271308 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.271413 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.271616 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.271702 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.271923 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.272010 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.272228 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.272315 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.272533 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.272620 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.272839 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.272925 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.273144 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.273230 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.273446 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.273531 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.273750 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.273845 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.274081 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.274169 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.274387 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.274472 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.274693 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.274795 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.275001 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.275086 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.275308 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.275394 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.275620 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.275784 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.275928 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.276015 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.276240 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.276335 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.276545 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.276687 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.276850 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.276938 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.277155 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.277248 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.277458 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.277545 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.277762 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.277907 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.278106 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.278204 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.278441 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.278547 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.278721 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.278815 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.279045 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.279132 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.279357 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.279444 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.279662 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.279748 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.280030 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.280123 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.280336 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.280423 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.280654 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.280742 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.280972 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.281067 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.281278 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.281371 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.281595 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.281681 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.281933 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.282037 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.282237 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.282322 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.282558 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.282645 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.282869 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.282957 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.283191 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.283278 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.283493 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.283579 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.283796 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.283882 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.284097 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.284183 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.284404 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.284490 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.284718 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.284805 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.285018 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.285102 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.285313 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.285407 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.285615 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.285700 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.285939 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.286019 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.286244 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.286377 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.287105 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.287190 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.287406 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.287482 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.287705 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.287789 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.288007 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.288081 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.288304 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.288378 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.288605 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.288688 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.288910 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.289001 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.289210 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.289285 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.289510 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.289586 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.289810 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.289883 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.290137 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.290240 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.290435 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.290522 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.290738 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.290880 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.291019 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.291151 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.291300 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.291428 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.291604 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.291722 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.291917 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.292088 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.292249 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.292392 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.292534 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.292685 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.292825 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.292979 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.293121 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.293261 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.293440 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.293584 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.293720 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.293872 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.294085 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.294233 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.294378 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.294535 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.294679 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.294820 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.294964 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.295115 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.295255 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.295418 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.295548 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.295683 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.295912 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.296026 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.296171 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.296317 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.296466 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.296557 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.296771 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.296859 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.297077 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.297163 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.297399 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.297487 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.297717 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.297804 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.298042 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.298133 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.298366 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.298462 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.298685 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.298774 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.298989 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.299135 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.299303 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.299389 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.299608 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.299700 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.299925 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.300040 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.300229 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.300318 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.300542 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.300639 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.300842 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.300943 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.301145 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.301232 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.301451 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.301536 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.301761 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.301874 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.302114 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.302215 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.302431 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.302530 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.302747 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.302856 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.303055 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.303151 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.303374 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.303470 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.303695 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.303791 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.304007 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.304117 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.304325 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.304422 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.304648 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.304751 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.304974 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.305061 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.305282 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.305385 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.305590 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.305677 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.305926 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.306016 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.306148 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 31 20:54:21.306249 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.306555 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.306861 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:54:21.307109 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 31 20:54:21.364804 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: INFO dbcounter [None req-c8e56113-975a-455b-be25-1cb9c0433c08 None None] Registered counter for database nova_api May 31 20:54:21.366019 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: INFO dbcounter [None req-4b0fb4f0-d22f-4c35-8475-18b704ea661a None None] Registered counter for database nova_api May 31 20:54:21.386113 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG oslo_db.sqlalchemy.engines [None req-c8e56113-975a-455b-be25-1cb9c0433c08 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103579) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 31 20:54:21.387521 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG oslo_db.sqlalchemy.engines [None req-4b0fb4f0-d22f-4c35-8475-18b704ea661a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103580) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 31 20:54:21.393704 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG dbcounter [-] [103579] Writer thread running {{(pid=103579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 31 20:54:21.394891 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG dbcounter [-] [103580] Writer thread running {{(pid=103580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 31 20:54:21.450795 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.context [None req-c8e56113-975a-455b-be25-1cb9c0433c08 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cc5ba698-8981-4abe-a800-db6251f99fd3(cell1) {{(pid=103579) load_cells /opt/stack/nova/nova/context.py:464}} May 31 20:54:21.451280 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.context [None req-4b0fb4f0-d22f-4c35-8475-18b704ea661a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cc5ba698-8981-4abe-a800-db6251f99fd3(cell1) {{(pid=103580) load_cells /opt/stack/nova/nova/context.py:464}} May 31 20:54:21.454936 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG oslo_concurrency.lockutils [None req-c8e56113-975a-455b-be25-1cb9c0433c08 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 20:54:21.455466 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG oslo_concurrency.lockutils [None req-4b0fb4f0-d22f-4c35-8475-18b704ea661a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 20:54:21.456492 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG oslo_concurrency.lockutils [None req-c8e56113-975a-455b-be25-1cb9c0433c08 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 20:54:21.457014 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG oslo_concurrency.lockutils [None req-4b0fb4f0-d22f-4c35-8475-18b704ea661a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 20:54:21.457269 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG oslo_concurrency.lockutils [None req-c8e56113-975a-455b-be25-1cb9c0433c08 None None] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 20:54:21.457794 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG oslo_concurrency.lockutils [None req-4b0fb4f0-d22f-4c35-8475-18b704ea661a None None] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 20:54:21.459931 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG oslo_concurrency.lockutils [None req-c8e56113-975a-455b-be25-1cb9c0433c08 None None] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 20:54:21.460361 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG oslo_concurrency.lockutils [None req-4b0fb4f0-d22f-4c35-8475-18b704ea661a None None] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 20:54:21.461965 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: INFO dbcounter [None req-c8e56113-975a-455b-be25-1cb9c0433c08 None None] Registered counter for database nova_cell0 May 31 20:54:21.462376 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: INFO dbcounter [None req-4b0fb4f0-d22f-4c35-8475-18b704ea661a None None] Registered counter for database nova_cell0 May 31 20:54:21.466290 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: INFO dbcounter [None req-c8e56113-975a-455b-be25-1cb9c0433c08 None None] Registered counter for database nova_cell1 May 31 20:54:21.466735 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: INFO dbcounter [None req-4b0fb4f0-d22f-4c35-8475-18b704ea661a None None] Registered counter for database nova_cell1 May 31 20:54:21.473668 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG oslo_db.sqlalchemy.engines [None req-c8e56113-975a-455b-be25-1cb9c0433c08 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103579) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 31 20:54:21.475476 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG oslo_db.sqlalchemy.engines [None req-c8e56113-975a-455b-be25-1cb9c0433c08 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103579) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 31 20:54:21.477643 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG oslo_db.sqlalchemy.engines [None req-4b0fb4f0-d22f-4c35-8475-18b704ea661a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103580) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 31 20:54:21.479324 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG oslo_db.sqlalchemy.engines [None req-4b0fb4f0-d22f-4c35-8475-18b704ea661a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103580) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 31 20:54:21.479465 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG dbcounter [-] [103579] Writer thread running {{(pid=103579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 31 20:54:21.485136 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG dbcounter [-] [103580] Writer thread running {{(pid=103580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 31 20:54:21.490519 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG dbcounter [-] [103580] Writer thread running {{(pid=103580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 31 20:54:21.628577 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG dbcounter [-] [103579] Writer thread running {{(pid=103579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 31 20:54:21.635281 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: INFO dbcounter [None req-4b0fb4f0-d22f-4c35-8475-18b704ea661a None None] Registered counter for database nova_cell0 May 31 20:54:21.638197 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: INFO dbcounter [None req-c8e56113-975a-455b-be25-1cb9c0433c08 None None] Registered counter for database nova_cell0 May 31 20:54:21.644750 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG oslo_db.sqlalchemy.engines [None req-4b0fb4f0-d22f-4c35-8475-18b704ea661a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103580) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 31 20:54:21.647993 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG oslo_db.sqlalchemy.engines [None req-c8e56113-975a-455b-be25-1cb9c0433c08 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103579) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 31 20:54:21.649996 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG dbcounter [-] [103580] Writer thread running {{(pid=103580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 31 20:54:21.652338 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG dbcounter [-] [103579] Writer thread running {{(pid=103579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 31 20:54:22.172123 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: WARNING keystonemiddleware.auth_token [None req-4b0fb4f0-d22f-4c35-8475-18b704ea661a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 31 20:54:22.179928 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: WARNING keystonemiddleware.auth_token [None req-4b0fb4f0-d22f-4c35-8475-18b704ea661a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 31 20:54:22.204072 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: WARNING keystonemiddleware.auth_token [None req-c8e56113-975a-455b-be25-1cb9c0433c08 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 31 20:54:22.211364 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: WARNING keystonemiddleware.auth_token [None req-c8e56113-975a-455b-be25-1cb9c0433c08 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 31 20:54:22.404396 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: WARNING keystonemiddleware.auth_token [None req-4b0fb4f0-d22f-4c35-8475-18b704ea661a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 31 20:54:22.410379 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: WARNING keystonemiddleware.auth_token [None req-4b0fb4f0-d22f-4c35-8475-18b704ea661a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 31 20:54:22.415970 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b81b5749c0 pid: 103580 (default app) May 31 20:54:22.418317 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi [None req-4b0fb4f0-d22f-4c35-8475-18b704ea661a None None] Calling method '>' {{(pid=103580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 20:54:22.419486 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: INFO nova.api.openstack.requestlog [None req-4b0fb4f0-d22f-4c35-8475-18b704ea661a None None] 10.222.0.55 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001985 May 31 20:54:22.419901 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: [pid: 103580|app: 0|req: 1/1] 10.222.0.55 () {50 vars in 788 bytes} [Tue May 31 20:54:22 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 20:54:22.434332 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: WARNING keystonemiddleware.auth_token [None req-c8e56113-975a-455b-be25-1cb9c0433c08 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 31 20:54:22.440274 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: WARNING keystonemiddleware.auth_token [None req-c8e56113-975a-455b-be25-1cb9c0433c08 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 31 20:54:22.445479 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b81b5749c0 pid: 103579 (default app) May 31 20:55:44.829808 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi [None req-4b0fb4f0-d22f-4c35-8475-18b704ea661a None None] Calling method '>' {{(pid=103580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 20:55:44.830753 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: INFO nova.api.openstack.requestlog [None req-4b0fb4f0-d22f-4c35-8475-18b704ea661a None None] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 May 31 20:55:44.836424 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: [pid: 103580|app: 0|req: 2/2] 10.222.0.55 () {54 vars in 930 bytes} [Tue May 31 20:55:44 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 20:55:44.846496 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG dbcounter [-] [103579] Writing DB stats nova_api:SELECT=3 {{(pid=103579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:55:44.847290 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG dbcounter [-] [103579] Writing DB stats nova_cell1:SELECT=3 {{(pid=103579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:55:44.847985 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG dbcounter [-] [103579] Writing DB stats nova_cell0:SELECT=3 {{(pid=103579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:55:44.848673 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG dbcounter [-] [103579] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:55:45.287072 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi [None req-3f8bbb51-74d1-447c-bdcc-674d6cfd32d6 admin admin] Calling method '>' {{(pid=103579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 20:55:45.320693 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: INFO nova.api.openstack.requestlog [None req-3f8bbb51-74d1-447c-bdcc-674d6cfd32d6 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.482011 May 31 20:55:45.327166 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: [pid: 103579|app: 0|req: 1/3] 10.222.0.55 () {60 vars in 1291 bytes} [Tue May 31 20:55:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 20:55:47.687890 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi [None req-4b0fb4f0-d22f-4c35-8475-18b704ea661a None None] Calling method '>' {{(pid=103580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 20:55:47.689473 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: INFO nova.api.openstack.requestlog [None req-4b0fb4f0-d22f-4c35-8475-18b704ea661a None None] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002000 May 31 20:55:47.689851 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: [pid: 103580|app: 0|req: 3/4] 10.222.0.55 () {54 vars in 930 bytes} [Tue May 31 20:55:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 20:55:47.751405 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi [None req-af88b029-45af-4e35-8474-08a9bc98b106 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 1, "vcpus": 1, "swap": 0, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "rxtx_factor": 1.0, "name": "cirros256"}} {{(pid=103579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 20:55:47.769813 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 31 20:55:47.769813 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: warnings.warn(msg) May 31 20:55:47.876419 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: INFO nova.api.openstack.requestlog [None req-af88b029-45af-4e35-8474-08a9bc98b106 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.180417 May 31 20:55:47.877123 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: [pid: 103579|app: 0|req: 2/5] 10.222.0.55 () {64 vars in 1282 bytes} [Tue May 31 20:55:47 2022] POST /compute/v2.1/flavors => generated 407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 20:55:47.890201 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG dbcounter [-] [103580] Writing DB stats nova_api:SELECT=3 {{(pid=103580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:55:47.891170 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG dbcounter [-] [103580] Writing DB stats nova_cell0:SELECT=3 {{(pid=103580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:55:47.892440 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG dbcounter [-] [103580] Writing DB stats nova_cell1:SELECT=3 {{(pid=103580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:55:47.893422 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG dbcounter [-] [103580] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:55:48.096244 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi [None req-4efe9cb6-10af-4341-a1f0-b9d801262a78 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 20:55:48.098697 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 31 20:55:48.098697 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: warnings.warn(msg) May 31 20:55:48.218892 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: INFO nova.api.openstack.requestlog [None req-4efe9cb6-10af-4341-a1f0-b9d801262a78 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.333798 May 31 20:55:48.220223 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: [pid: 103580|app: 0|req: 4/6] 10.222.0.55 () {64 vars in 1335 bytes} [Tue May 31 20:55:47 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 20:55:50.539596 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi [None req-af88b029-45af-4e35-8474-08a9bc98b106 admin admin] Calling method '>' {{(pid=103579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 20:55:50.540738 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: INFO nova.api.openstack.requestlog [None req-af88b029-45af-4e35-8474-08a9bc98b106 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001610 May 31 20:55:50.541246 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: [pid: 103579|app: 0|req: 3/7] 10.222.0.55 () {54 vars in 930 bytes} [Tue May 31 20:55:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 20:55:50.648258 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi [None req-4ec74f0b-c975-4874-86d4-52ccde449460 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "disk": 5, "id": "d1", "name": "ds512M", "vcpus": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=103580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 20:55:50.666038 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 31 20:55:50.666038 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: warnings.warn(msg) May 31 20:55:50.795620 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: INFO nova.api.openstack.requestlog [None req-4ec74f0b-c975-4874-86d4-52ccde449460 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.248337 May 31 20:55:50.796672 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: [pid: 103580|app: 0|req: 5/8] 10.222.0.55 () {64 vars in 1282 bytes} [Tue May 31 20:55:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 20:55:50.809227 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi [None req-9fa09ac8-3653-4493-8689-4a0166d55c57 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 20:55:50.811201 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 31 20:55:50.811201 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: warnings.warn(msg) May 31 20:55:50.919350 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: INFO nova.api.openstack.requestlog [None req-9fa09ac8-3653-4493-8689-4a0166d55c57 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.113955 May 31 20:55:50.919798 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: [pid: 103579|app: 0|req: 4/9] 10.222.0.55 () {64 vars in 1335 bytes} [Tue May 31 20:55:50 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 20:55:53.270299 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi [None req-4ec74f0b-c975-4874-86d4-52ccde449460 admin admin] Calling method '>' {{(pid=103580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 20:55:53.271323 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: INFO nova.api.openstack.requestlog [None req-4ec74f0b-c975-4874-86d4-52ccde449460 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001602 May 31 20:55:53.271732 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: [pid: 103580|app: 0|req: 6/10] 10.222.0.55 () {54 vars in 930 bytes} [Tue May 31 20:55:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 20:55:53.334337 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi [None req-135d2868-c8d9-41fb-88b7-6d77691f3fac admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "name": "ds1G", "rxtx_factor": 1.0, "vcpus": 1, "id": "d2", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 10}} {{(pid=103579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 20:55:53.405036 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: INFO nova.api.openstack.requestlog [None req-135d2868-c8d9-41fb-88b7-6d77691f3fac admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.127233 May 31 20:55:53.411758 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: [pid: 103579|app: 0|req: 5/11] 10.222.0.55 () {64 vars in 1282 bytes} [Tue May 31 20:55:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 20:55:53.421999 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi [None req-41ab9a39-54d1-4d83-8463-6aaae48686eb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 20:55:53.505539 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: INFO nova.api.openstack.requestlog [None req-41ab9a39-54d1-4d83-8463-6aaae48686eb admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090165 May 31 20:55:53.514467 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: [pid: 103580|app: 0|req: 7/12] 10.222.0.55 () {64 vars in 1335 bytes} [Tue May 31 20:55:53 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 20:55:55.888442 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi [None req-135d2868-c8d9-41fb-88b7-6d77691f3fac admin admin] Calling method '>' {{(pid=103579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 20:55:55.889554 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: INFO nova.api.openstack.requestlog [None req-135d2868-c8d9-41fb-88b7-6d77691f3fac admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001814 May 31 20:55:55.890007 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: [pid: 103579|app: 0|req: 6/13] 10.222.0.55 () {54 vars in 930 bytes} [Tue May 31 20:55:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 20:55:55.957821 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi [None req-dcd6d0e6-d38d-47e3-80ba-5d018f263b5a admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 2, "name": "ds2G", "swap": 0, "id": "d3", "ram": 2048, "rxtx_factor": 1.0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 20:55:56.038048 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: INFO nova.api.openstack.requestlog [None req-dcd6d0e6-d38d-47e3-80ba-5d018f263b5a admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.141410 May 31 20:55:56.038709 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: [pid: 103580|app: 0|req: 8/14] 10.222.0.55 () {64 vars in 1282 bytes} [Tue May 31 20:55:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 20:55:56.051450 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi [None req-a6cdfda6-1088-4a21-ae4b-4b8f3076bb1b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 20:55:56.170231 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: INFO nova.api.openstack.requestlog [None req-a6cdfda6-1088-4a21-ae4b-4b8f3076bb1b admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.122833 May 31 20:55:56.170476 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: [pid: 103579|app: 0|req: 7/15] 10.222.0.55 () {64 vars in 1335 bytes} [Tue May 31 20:55:56 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 20:55:58.510845 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi [None req-dcd6d0e6-d38d-47e3-80ba-5d018f263b5a admin admin] Calling method '>' {{(pid=103580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 20:55:58.511849 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: INFO nova.api.openstack.requestlog [None req-dcd6d0e6-d38d-47e3-80ba-5d018f263b5a admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 May 31 20:55:58.512450 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: [pid: 103580|app: 0|req: 9/16] 10.222.0.55 () {54 vars in 930 bytes} [Tue May 31 20:55:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 20:55:58.575152 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi [None req-51b69fee-f7b6-4bcc-80d3-11386276d46d admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "vcpus": 4, "swap": 0, "ram": 4096, "disk": 20, "os-flavor-access:is_public": true}} {{(pid=103579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 20:55:58.639803 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: INFO nova.api.openstack.requestlog [None req-51b69fee-f7b6-4bcc-80d3-11386276d46d admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.121073 May 31 20:55:58.640931 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: [pid: 103579|app: 0|req: 8/17] 10.222.0.55 () {64 vars in 1282 bytes} [Tue May 31 20:55:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 31 20:55:58.652861 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi [None req-93f77f84-6aef-4049-b54e-857da1a84494 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 20:55:58.741271 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: INFO nova.api.openstack.requestlog [None req-93f77f84-6aef-4049-b54e-857da1a84494 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.081927 May 31 20:55:58.741271 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: [pid: 103580|app: 0|req: 10/18] 10.222.0.55 () {64 vars in 1335 bytes} [Tue May 31 20:55:58 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 20:56:01.068946 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi [None req-51b69fee-f7b6-4bcc-80d3-11386276d46d admin admin] Calling method '>' {{(pid=103579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 20:56:01.070033 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: INFO nova.api.openstack.requestlog [None req-51b69fee-f7b6-4bcc-80d3-11386276d46d admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 May 31 20:56:01.070745 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: [pid: 103579|app: 0|req: 9/19] 10.222.0.55 () {54 vars in 930 bytes} [Tue May 31 20:56:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 20:56:01.134773 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi [None req-9b368541-cb83-44b8-bd60-85b441693664 admin admin] Calling method '>' {{(pid=103580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 20:56:01.162602 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: INFO nova.api.openstack.requestlog [None req-9b368541-cb83-44b8-bd60-85b441693664 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.085484 May 31 20:56:01.163431 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: [pid: 103580|app: 0|req: 11/20] 10.222.0.55 () {60 vars in 1291 bytes} [Tue May 31 20:56:01 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 20:56:03.548183 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi [None req-51b69fee-f7b6-4bcc-80d3-11386276d46d admin admin] Calling method '>' {{(pid=103579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 20:56:03.549209 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: INFO nova.api.openstack.requestlog [None req-51b69fee-f7b6-4bcc-80d3-11386276d46d admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 May 31 20:56:03.549615 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: [pid: 103579|app: 0|req: 10/21] 10.222.0.55 () {54 vars in 930 bytes} [Tue May 31 20:56:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 20:56:03.627119 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi [None req-cbfec3dd-f577-432f-a7e7-f5ecde3950ec admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "id": "1", "ram": 512, "name": "m1.tiny", "disk": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=103580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 20:56:03.715138 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: INFO nova.api.openstack.requestlog [None req-cbfec3dd-f577-432f-a7e7-f5ecde3950ec admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.159315 May 31 20:56:03.715709 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: [pid: 103580|app: 0|req: 12/22] 10.222.0.55 () {64 vars in 1282 bytes} [Tue May 31 20:56:03 2022] POST /compute/v2.1/flavors => generated 402 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 20:56:03.728233 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi [None req-1b64c4bd-c32d-48a5-be54-7a7303b4bdc5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 20:56:03.797927 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: INFO nova.api.openstack.requestlog [None req-1b64c4bd-c32d-48a5-be54-7a7303b4bdc5 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.073457 May 31 20:56:03.799442 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: [pid: 103579|app: 0|req: 11/23] 10.222.0.55 () {64 vars in 1332 bytes} [Tue May 31 20:56:03 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 20:56:06.289978 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi [None req-cbfec3dd-f577-432f-a7e7-f5ecde3950ec admin admin] Calling method '>' {{(pid=103580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 20:56:06.291001 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: INFO nova.api.openstack.requestlog [None req-cbfec3dd-f577-432f-a7e7-f5ecde3950ec admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001539 May 31 20:56:06.291412 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: [pid: 103580|app: 0|req: 13/24] 10.222.0.55 () {54 vars in 930 bytes} [Tue May 31 20:56:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 20:56:06.357854 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi [None req-e7a4a216-fdbc-4b60-921d-282769e04e6e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "ram": 2048, "os-flavor-access:is_public": true, "disk": 20, "id": "2", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0}} {{(pid=103579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 20:56:06.440216 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: INFO nova.api.openstack.requestlog [None req-e7a4a216-fdbc-4b60-921d-282769e04e6e admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.142556 May 31 20:56:06.440830 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: [pid: 103579|app: 0|req: 12/25] 10.222.0.55 () {64 vars in 1282 bytes} [Tue May 31 20:56:06 2022] POST /compute/v2.1/flavors => generated 405 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 20:56:06.456268 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi [None req-4235db45-94af-4808-a500-635f7561d419 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 20:56:06.554976 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: INFO nova.api.openstack.requestlog [None req-4235db45-94af-4808-a500-635f7561d419 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103360 May 31 20:56:06.555602 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: [pid: 103580|app: 0|req: 14/26] 10.222.0.55 () {64 vars in 1332 bytes} [Tue May 31 20:56:06 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 20:56:08.932569 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi [None req-e7a4a216-fdbc-4b60-921d-282769e04e6e admin admin] Calling method '>' {{(pid=103579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 20:56:08.933610 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: INFO nova.api.openstack.requestlog [None req-e7a4a216-fdbc-4b60-921d-282769e04e6e admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 May 31 20:56:08.934252 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: [pid: 103579|app: 0|req: 13/27] 10.222.0.55 () {54 vars in 930 bytes} [Tue May 31 20:56:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 20:56:08.992754 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi [None req-d3019b98-c337-4493-885c-91edd8ff3cfd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "os-flavor-access:is_public": true, "id": "3", "ram": 4096, "rxtx_factor": 1.0, "swap": 0}} {{(pid=103580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 20:56:09.067802 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: INFO nova.api.openstack.requestlog [None req-d3019b98-c337-4493-885c-91edd8ff3cfd admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.127784 May 31 20:56:09.068323 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: [pid: 103580|app: 0|req: 15/28] 10.222.0.55 () {64 vars in 1282 bytes} [Tue May 31 20:56:08 2022] POST /compute/v2.1/flavors => generated 406 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 20:56:09.080729 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi [None req-1571fec3-22d5-4586-a501-5896b8c084dd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 20:56:09.163557 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: INFO nova.api.openstack.requestlog [None req-1571fec3-22d5-4586-a501-5896b8c084dd admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.087132 May 31 20:56:09.164151 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: [pid: 103579|app: 0|req: 14/29] 10.222.0.55 () {64 vars in 1332 bytes} [Tue May 31 20:56:09 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 20:56:11.471731 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi [None req-d3019b98-c337-4493-885c-91edd8ff3cfd admin admin] Calling method '>' {{(pid=103580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 20:56:11.472512 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: INFO nova.api.openstack.requestlog [None req-d3019b98-c337-4493-885c-91edd8ff3cfd admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 May 31 20:56:11.473193 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: [pid: 103580|app: 0|req: 16/30] 10.222.0.55 () {54 vars in 930 bytes} [Tue May 31 20:56:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 20:56:11.531451 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi [None req-f9552c95-ec48-4b9e-9257-5012b39b8392 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "4", "vcpus": 4, "ram": 8192, "name": "m1.large", "disk": 80, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 20:56:11.639211 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: INFO nova.api.openstack.requestlog [None req-f9552c95-ec48-4b9e-9257-5012b39b8392 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.159618 May 31 20:56:11.640328 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: [pid: 103579|app: 0|req: 15/31] 10.222.0.55 () {64 vars in 1282 bytes} [Tue May 31 20:56:11 2022] POST /compute/v2.1/flavors => generated 405 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 20:56:11.652312 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi [None req-baa6967b-0f6c-43ff-9bfc-7cc7f3bfd344 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 20:56:11.750105 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: INFO nova.api.openstack.requestlog [None req-baa6967b-0f6c-43ff-9bfc-7cc7f3bfd344 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.100927 May 31 20:56:11.765929 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: [pid: 103580|app: 0|req: 17/32] 10.222.0.55 () {64 vars in 1332 bytes} [Tue May 31 20:56:11 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 20:56:14.150160 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi [None req-f9552c95-ec48-4b9e-9257-5012b39b8392 admin admin] Calling method '>' {{(pid=103579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 20:56:14.151786 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: INFO nova.api.openstack.requestlog [None req-f9552c95-ec48-4b9e-9257-5012b39b8392 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002095 May 31 20:56:14.152192 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: [pid: 103579|app: 0|req: 16/33] 10.222.0.55 () {54 vars in 930 bytes} [Tue May 31 20:56:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 20:56:14.228004 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi [None req-38827eeb-ea19-4b90-93af-63ce37742088 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 16384, "id": "5", "rxtx_factor": 1.0, "vcpus": 8, "disk": 160, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=103580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 20:56:14.303056 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: INFO nova.api.openstack.requestlog [None req-38827eeb-ea19-4b90-93af-63ce37742088 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.143728 May 31 20:56:14.304435 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: [pid: 103580|app: 0|req: 18/34] 10.222.0.55 () {64 vars in 1282 bytes} [Tue May 31 20:56:14 2022] POST /compute/v2.1/flavors => generated 408 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 20:56:14.316204 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi [None req-b9664689-0722-43b2-95d7-6084769dc805 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 20:56:14.446447 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: INFO nova.api.openstack.requestlog [None req-b9664689-0722-43b2-95d7-6084769dc805 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.133887 May 31 20:56:14.449112 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: [pid: 103579|app: 0|req: 17/35] 10.222.0.55 () {64 vars in 1332 bytes} [Tue May 31 20:56:14 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 20:56:38.720077 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi [None req-38827eeb-ea19-4b90-93af-63ce37742088 admin admin] Calling method '>' {{(pid=103580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 20:56:38.721088 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: INFO nova.api.openstack.requestlog [None req-38827eeb-ea19-4b90-93af-63ce37742088 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 May 31 20:56:38.721493 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: [pid: 103580|app: 0|req: 19/36] 10.222.0.55 () {54 vars in 930 bytes} [Tue May 31 20:56:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 20:56:38.732361 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG dbcounter [-] [103579] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:56:38.780421 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi [None req-4502f486-2aa1-474d-b8c5-78336eefc899 admin admin] Calling method '>' {{(pid=103579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 20:56:38.797376 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: INFO nova.api.openstack.requestlog [None req-4502f486-2aa1-474d-b8c5-78336eefc899 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.069478 May 31 20:56:38.797940 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: [pid: 103579|app: 0|req: 18/37] 10.222.0.55 () {60 vars in 1291 bytes} [Tue May 31 20:56:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 20:56:39.788324 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi [None req-38827eeb-ea19-4b90-93af-63ce37742088 admin admin] Calling method '>' {{(pid=103580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 20:56:39.789363 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: INFO nova.api.openstack.requestlog [None req-38827eeb-ea19-4b90-93af-63ce37742088 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 May 31 20:56:39.789772 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: [pid: 103580|app: 0|req: 20/38] 10.222.0.55 () {56 vars in 1074 bytes} [Tue May 31 20:56:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 20:56:39.996246 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi [None req-76ee784c-ed41-45e6-bb60-ae498858dab8 admin admin] Calling method '>' {{(pid=103579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 20:56:40.000489 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: INFO nova.api.openstack.wsgi [None req-76ee784c-ed41-45e6-bb60-ae498858dab8 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 31 20:56:40.003931 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi [None req-76ee784c-ed41-45e6-bb60-ae498858dab8 admin admin] Request method failure captured: May 31 20:56:40.003931 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 31 20:56:40.003931 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: Accept: application/json May 31 20:56:40.003931 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: Accept-Encoding: gzip, deflate May 31 20:56:40.003931 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: Connection: keep-alive May 31 20:56:40.003931 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: Content-Length: 0 May 31 20:56:40.003931 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: Host: 10.222.0.55 May 31 20:56:40.003931 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: Openstack-Api-Version: compute 2.90 May 31 20:56:40.003931 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: Openstack-System-Scope: None May 31 20:56:40.003931 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: User-Agent: python-novaclient May 31 20:56:40.003931 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: X-Auth-Token: gAAAAABiloEHC1NvPKTdLRc--cgfb4D_FjGxO5Szhk2nWDsZs8J3FqzEYhWgpejGQxaiHejiS6Oz3b0ZqiUOuknOnvkeEXprCl5-npDDWmjvWJZTn9gZrhHHmq2nOkiWHRO6eU6XkZKuuhIdNb30Prl4Us_VPwrJWw_iFbA1l1EjHZKHgZXRcsA May 31 20:56:40.003931 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: X-Domain-Id: None May 31 20:56:40.003931 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: X-Domain-Name: None May 31 20:56:40.003931 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: X-Identity-Status: Confirmed May 31 20:56:40.003931 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: X-Is-Admin-Project: True May 31 20:56:40.003931 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: X-Openstack-Nova-Api-Version: 2.90 May 31 20:56:40.003931 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: X-Project-Domain-Id: default May 31 20:56:40.003931 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: X-Project-Domain-Name: Default May 31 20:56:40.003931 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: X-Project-Id: f6a1a8d766964543bcc4e46371605ff7 May 31 20:56:40.003931 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: X-Project-Name: admin May 31 20:56:40.003931 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: X-Role: member,admin,reader May 31 20:56:40.003931 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: X-Roles: member,admin,reader May 31 20:56:40.005637 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/f6a1a8d766964543bcc4e46371605ff7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f6a1a8d766964543bcc4e46371605ff7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_f6a1a8d766964543bcc4e46371605ff7", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f6a1a8d766964543bcc4e46371605ff7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] May 31 20:56:40.005637 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: X-Tenant: admin May 31 20:56:40.005637 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: X-Tenant-Id: f6a1a8d766964543bcc4e46371605ff7 May 31 20:56:40.005637 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: X-Tenant-Name: admin May 31 20:56:40.005637 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: X-User: admin May 31 20:56:40.005637 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: X-User-Domain-Id: default May 31 20:56:40.005637 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: X-User-Domain-Name: Default May 31 20:56:40.005637 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: X-User-Id: 8f14392ec7e347fab1ef8b6cbe7e2488 May 31 20:56:40.005637 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: X-User-Name: admin May 31 20:56:40.005637 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: method: > May 31 20:56:40.005637 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: exception: Flavor 42 could not be found. May 31 20:56:40.005637 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: action_args: {'id': '42'} May 31 20:56:40.005637 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: {{(pid=103579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 20:56:40.005637 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 20:56:40.007050 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 31 20:56:40.007050 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 31 20:56:40.007050 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 31 20:56:40.007050 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 31 20:56:40.007050 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 31 20:56:40.007050 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 31 20:56:40.007050 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 31 20:56:40.007050 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 31 20:56:40.007050 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 31 20:56:40.007050 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 20:56:40.007050 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 31 20:56:40.007050 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 31 20:56:40.007050 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 31 20:56:40.007050 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi May 31 20:56:40.007050 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 20:56:40.007050 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi May 31 20:56:40.007050 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 20:56:40.007050 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 20:56:40.007050 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 20:56:40.008524 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 20:56:40.008524 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 20:56:40.008524 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 20:56:40.008524 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 20:56:40.008524 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 31 20:56:40.008524 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 31 20:56:40.008524 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 31 20:56:40.008524 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi May 31 20:56:40.008524 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 20:56:40.008524 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi May 31 20:56:40.008524 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 20:56:40.008524 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 20:56:40.008524 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 20:56:40.008524 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 20:56:40.008524 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 20:56:40.008524 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 31 20:56:40.008524 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi May 31 20:56:40.008524 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi [None req-76ee784c-ed41-45e6-bb60-ae498858dab8 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103579) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 20:56:40.009831 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: INFO nova.api.openstack.requestlog [None req-76ee784c-ed41-45e6-bb60-ae498858dab8 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062294 May 31 20:56:40.009831 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: [pid: 103579|app: 0|req: 19/39] 10.222.0.55 () {60 vars in 1190 bytes} [Tue May 31 20:56:39 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 31 20:56:40.015125 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi [None req-655e4a27-e8c6-4861-9bad-74543e138b3c admin admin] Calling method '>' {{(pid=103580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 20:56:40.018104 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG dbcounter [-] [103580] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:56:40.036588 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: INFO nova.api.openstack.requestlog [None req-655e4a27-e8c6-4861-9bad-74543e138b3c admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025074 May 31 20:56:40.037127 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: [pid: 103580|app: 0|req: 21/40] 10.222.0.55 () {60 vars in 1210 bytes} [Tue May 31 20:56:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 20:56:40.047600 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi [None req-cd4fd973-0e0e-402b-a6d1-cb36c5d0b4d4 admin admin] Calling method '>' {{(pid=103579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 20:56:40.069038 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: INFO nova.api.openstack.requestlog [None req-cd4fd973-0e0e-402b-a6d1-cb36c5d0b4d4 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025792 May 31 20:56:40.069597 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: [pid: 103579|app: 0|req: 20/41] 10.222.0.55 () {60 vars in 1210 bytes} [Tue May 31 20:56:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 20:56:40.079458 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi [None req-154d330d-520a-44c6-9dc9-7132820a7c73 admin admin] Calling method '>' {{(pid=103580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 20:56:40.085109 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: INFO nova.api.openstack.wsgi [None req-154d330d-520a-44c6-9dc9-7132820a7c73 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 31 20:56:40.088344 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi [None req-154d330d-520a-44c6-9dc9-7132820a7c73 admin admin] Request method failure captured: May 31 20:56:40.088344 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 31 20:56:40.088344 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: Accept: application/json May 31 20:56:40.088344 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: Accept-Encoding: gzip, deflate May 31 20:56:40.088344 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: Connection: keep-alive May 31 20:56:40.088344 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: Content-Length: 0 May 31 20:56:40.088344 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: Host: 10.222.0.55 May 31 20:56:40.088344 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: Openstack-Api-Version: compute 2.90 May 31 20:56:40.088344 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: Openstack-System-Scope: None May 31 20:56:40.088344 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: User-Agent: python-novaclient May 31 20:56:40.088344 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: X-Auth-Token: gAAAAABiloEHC1NvPKTdLRc--cgfb4D_FjGxO5Szhk2nWDsZs8J3FqzEYhWgpejGQxaiHejiS6Oz3b0ZqiUOuknOnvkeEXprCl5-npDDWmjvWJZTn9gZrhHHmq2nOkiWHRO6eU6XkZKuuhIdNb30Prl4Us_VPwrJWw_iFbA1l1EjHZKHgZXRcsA May 31 20:56:40.088344 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: X-Domain-Id: None May 31 20:56:40.088344 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: X-Domain-Name: None May 31 20:56:40.088344 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: X-Identity-Status: Confirmed May 31 20:56:40.088344 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: X-Is-Admin-Project: True May 31 20:56:40.088344 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: X-Openstack-Nova-Api-Version: 2.90 May 31 20:56:40.088344 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: X-Project-Domain-Id: default May 31 20:56:40.088344 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: X-Project-Domain-Name: Default May 31 20:56:40.088344 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: X-Project-Id: f6a1a8d766964543bcc4e46371605ff7 May 31 20:56:40.088344 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: X-Project-Name: admin May 31 20:56:40.088344 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: X-Role: member,admin,reader May 31 20:56:40.088344 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: X-Roles: member,admin,reader May 31 20:56:40.091390 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/f6a1a8d766964543bcc4e46371605ff7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f6a1a8d766964543bcc4e46371605ff7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_f6a1a8d766964543bcc4e46371605ff7", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f6a1a8d766964543bcc4e46371605ff7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] May 31 20:56:40.091390 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: X-Tenant: admin May 31 20:56:40.091390 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: X-Tenant-Id: f6a1a8d766964543bcc4e46371605ff7 May 31 20:56:40.091390 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: X-Tenant-Name: admin May 31 20:56:40.091390 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: X-User: admin May 31 20:56:40.091390 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: X-User-Domain-Id: default May 31 20:56:40.091390 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: X-User-Domain-Name: Default May 31 20:56:40.091390 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: X-User-Id: 8f14392ec7e347fab1ef8b6cbe7e2488 May 31 20:56:40.091390 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: X-User-Name: admin May 31 20:56:40.091390 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: method: > May 31 20:56:40.091390 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: exception: Flavor 42 could not be found. May 31 20:56:40.091390 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: action_args: {'id': '42'} May 31 20:56:40.091390 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: {{(pid=103580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 20:56:40.091390 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 20:56:40.092337 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 31 20:56:40.092337 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 31 20:56:40.092337 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 31 20:56:40.092337 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 31 20:56:40.092337 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 31 20:56:40.092337 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 31 20:56:40.092337 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 31 20:56:40.092337 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 31 20:56:40.092337 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 31 20:56:40.092337 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 20:56:40.092337 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 31 20:56:40.092337 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 31 20:56:40.092337 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 31 20:56:40.092337 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi May 31 20:56:40.092337 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 20:56:40.092337 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi May 31 20:56:40.092337 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 20:56:40.092337 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 20:56:40.092337 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 20:56:40.093652 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 20:56:40.093652 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 20:56:40.093652 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 20:56:40.093652 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 20:56:40.093652 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 31 20:56:40.093652 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 31 20:56:40.093652 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 31 20:56:40.093652 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi May 31 20:56:40.093652 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 20:56:40.093652 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi May 31 20:56:40.093652 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 20:56:40.093652 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 20:56:40.093652 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 20:56:40.093652 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 20:56:40.093652 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 20:56:40.093652 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 31 20:56:40.093652 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi May 31 20:56:40.093652 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi [None req-154d330d-520a-44c6-9dc9-7132820a7c73 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 20:56:40.095004 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: INFO nova.api.openstack.requestlog [None req-154d330d-520a-44c6-9dc9-7132820a7c73 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014221 May 31 20:56:40.095004 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: [pid: 103580|app: 0|req: 22/42] 10.222.0.55 () {60 vars in 1190 bytes} [Tue May 31 20:56:40 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 31 20:56:40.956010 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi [None req-cd4fd973-0e0e-402b-a6d1-cb36c5d0b4d4 admin admin] Calling method '>' {{(pid=103579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 20:56:40.957019 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: INFO nova.api.openstack.requestlog [None req-cd4fd973-0e0e-402b-a6d1-cb36c5d0b4d4 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 May 31 20:56:40.957419 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: [pid: 103579|app: 0|req: 21/43] 10.222.0.55 () {56 vars in 1074 bytes} [Tue May 31 20:56:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 20:56:41.147757 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi [None req-79cb2092-4cc9-4952-af19-618edb3891d8 admin admin] Calling method '>' {{(pid=103580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 20:56:41.153032 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: INFO nova.api.openstack.wsgi [None req-79cb2092-4cc9-4952-af19-618edb3891d8 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 31 20:56:41.155051 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi [None req-79cb2092-4cc9-4952-af19-618edb3891d8 admin admin] Request method failure captured: May 31 20:56:41.155051 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 31 20:56:41.155051 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: Accept: application/json May 31 20:56:41.155051 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: Accept-Encoding: gzip, deflate May 31 20:56:41.155051 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: Connection: keep-alive May 31 20:56:41.155051 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: Content-Length: 0 May 31 20:56:41.155051 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: Host: 10.222.0.55 May 31 20:56:41.155051 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: Openstack-Api-Version: compute 2.90 May 31 20:56:41.155051 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: Openstack-System-Scope: None May 31 20:56:41.155051 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: User-Agent: python-novaclient May 31 20:56:41.155051 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: X-Auth-Token: gAAAAABiloEI72Yx_KR8v0QmMkFgNJUyuH0AFXZgSrWIzozzLCk2N2sTbjrt5s1PBrd5ieWXdHd3qyZEbXmkdkoAVu5TqQniYoV7h6HyreMvVkvVsayNtD3oZhNswF2uLFTseloumR6gx81YVd_PN4n7Vmqg3TlQgzgWL9U45pMJBwguMxSBGR0 May 31 20:56:41.155051 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: X-Domain-Id: None May 31 20:56:41.155051 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: X-Domain-Name: None May 31 20:56:41.155051 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: X-Identity-Status: Confirmed May 31 20:56:41.155051 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: X-Is-Admin-Project: True May 31 20:56:41.155051 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: X-Openstack-Nova-Api-Version: 2.90 May 31 20:56:41.155051 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: X-Project-Domain-Id: default May 31 20:56:41.155051 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: X-Project-Domain-Name: Default May 31 20:56:41.155051 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: X-Project-Id: f6a1a8d766964543bcc4e46371605ff7 May 31 20:56:41.155051 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: X-Project-Name: admin May 31 20:56:41.155051 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: X-Role: member,admin,reader May 31 20:56:41.155051 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: X-Roles: member,admin,reader May 31 20:56:41.156619 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/f6a1a8d766964543bcc4e46371605ff7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f6a1a8d766964543bcc4e46371605ff7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_f6a1a8d766964543bcc4e46371605ff7", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f6a1a8d766964543bcc4e46371605ff7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] May 31 20:56:41.156619 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: X-Tenant: admin May 31 20:56:41.156619 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: X-Tenant-Id: f6a1a8d766964543bcc4e46371605ff7 May 31 20:56:41.156619 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: X-Tenant-Name: admin May 31 20:56:41.156619 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: X-User: admin May 31 20:56:41.156619 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: X-User-Domain-Id: default May 31 20:56:41.156619 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: X-User-Domain-Name: Default May 31 20:56:41.156619 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: X-User-Id: 8f14392ec7e347fab1ef8b6cbe7e2488 May 31 20:56:41.156619 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: X-User-Name: admin May 31 20:56:41.156619 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: method: > May 31 20:56:41.156619 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: exception: Flavor 84 could not be found. May 31 20:56:41.156619 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: action_args: {'id': '84'} May 31 20:56:41.156619 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: {{(pid=103580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 20:56:41.156619 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 20:56:41.157579 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 31 20:56:41.157579 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 31 20:56:41.157579 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 31 20:56:41.157579 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 31 20:56:41.157579 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 31 20:56:41.157579 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 31 20:56:41.157579 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 31 20:56:41.157579 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 31 20:56:41.157579 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 31 20:56:41.157579 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 20:56:41.157579 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 31 20:56:41.157579 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 31 20:56:41.157579 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 31 20:56:41.157579 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi May 31 20:56:41.157579 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 20:56:41.157579 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi May 31 20:56:41.157579 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 20:56:41.157579 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 20:56:41.157579 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 20:56:41.158653 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 20:56:41.158653 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 20:56:41.158653 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 20:56:41.158653 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 20:56:41.158653 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 31 20:56:41.158653 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 31 20:56:41.158653 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 31 20:56:41.158653 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi May 31 20:56:41.158653 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 20:56:41.158653 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi May 31 20:56:41.158653 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 20:56:41.158653 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 20:56:41.158653 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 20:56:41.158653 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 20:56:41.158653 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 20:56:41.158653 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 31 20:56:41.158653 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi May 31 20:56:41.158653 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi [None req-79cb2092-4cc9-4952-af19-618edb3891d8 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 20:56:41.159663 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: INFO nova.api.openstack.requestlog [None req-79cb2092-4cc9-4952-af19-618edb3891d8 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060657 May 31 20:56:41.159663 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: [pid: 103580|app: 0|req: 23/44] 10.222.0.55 () {60 vars in 1190 bytes} [Tue May 31 20:56:41 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 31 20:56:41.166212 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi [None req-73b30c23-c5c1-431f-99a0-500df43d3b9e admin admin] Calling method '>' {{(pid=103579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 20:56:41.180385 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: INFO nova.api.openstack.requestlog [None req-73b30c23-c5c1-431f-99a0-500df43d3b9e admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017779 May 31 20:56:41.180934 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: [pid: 103579|app: 0|req: 22/45] 10.222.0.55 () {60 vars in 1210 bytes} [Tue May 31 20:56:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 20:56:41.190665 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi [None req-7f6be0b7-a055-421f-934f-ae247937cfd0 admin admin] Calling method '>' {{(pid=103580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 20:56:41.204493 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: INFO nova.api.openstack.requestlog [None req-7f6be0b7-a055-421f-934f-ae247937cfd0 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017666 May 31 20:56:41.205024 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: [pid: 103580|app: 0|req: 24/46] 10.222.0.55 () {60 vars in 1210 bytes} [Tue May 31 20:56:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 20:56:41.214420 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi [None req-ddb77eaa-e7ba-4a98-9aeb-84263de54a56 admin admin] Calling method '>' {{(pid=103579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 20:56:41.220367 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: INFO nova.api.openstack.wsgi [None req-ddb77eaa-e7ba-4a98-9aeb-84263de54a56 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 31 20:56:41.221878 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi [None req-ddb77eaa-e7ba-4a98-9aeb-84263de54a56 admin admin] Request method failure captured: May 31 20:56:41.221878 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 31 20:56:41.221878 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: Accept: application/json May 31 20:56:41.221878 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: Accept-Encoding: gzip, deflate May 31 20:56:41.221878 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: Connection: keep-alive May 31 20:56:41.221878 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: Content-Length: 0 May 31 20:56:41.221878 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: Host: 10.222.0.55 May 31 20:56:41.221878 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: Openstack-Api-Version: compute 2.90 May 31 20:56:41.221878 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: Openstack-System-Scope: None May 31 20:56:41.221878 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: User-Agent: python-novaclient May 31 20:56:41.221878 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: X-Auth-Token: gAAAAABiloEI72Yx_KR8v0QmMkFgNJUyuH0AFXZgSrWIzozzLCk2N2sTbjrt5s1PBrd5ieWXdHd3qyZEbXmkdkoAVu5TqQniYoV7h6HyreMvVkvVsayNtD3oZhNswF2uLFTseloumR6gx81YVd_PN4n7Vmqg3TlQgzgWL9U45pMJBwguMxSBGR0 May 31 20:56:41.221878 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: X-Domain-Id: None May 31 20:56:41.221878 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: X-Domain-Name: None May 31 20:56:41.221878 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: X-Identity-Status: Confirmed May 31 20:56:41.221878 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: X-Is-Admin-Project: True May 31 20:56:41.221878 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: X-Openstack-Nova-Api-Version: 2.90 May 31 20:56:41.221878 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: X-Project-Domain-Id: default May 31 20:56:41.221878 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: X-Project-Domain-Name: Default May 31 20:56:41.221878 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: X-Project-Id: f6a1a8d766964543bcc4e46371605ff7 May 31 20:56:41.221878 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: X-Project-Name: admin May 31 20:56:41.221878 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: X-Role: member,admin,reader May 31 20:56:41.221878 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: X-Roles: member,admin,reader May 31 20:56:41.223274 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/f6a1a8d766964543bcc4e46371605ff7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f6a1a8d766964543bcc4e46371605ff7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_f6a1a8d766964543bcc4e46371605ff7", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f6a1a8d766964543bcc4e46371605ff7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] May 31 20:56:41.223274 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: X-Tenant: admin May 31 20:56:41.223274 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: X-Tenant-Id: f6a1a8d766964543bcc4e46371605ff7 May 31 20:56:41.223274 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: X-Tenant-Name: admin May 31 20:56:41.223274 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: X-User: admin May 31 20:56:41.223274 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: X-User-Domain-Id: default May 31 20:56:41.223274 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: X-User-Domain-Name: Default May 31 20:56:41.223274 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: X-User-Id: 8f14392ec7e347fab1ef8b6cbe7e2488 May 31 20:56:41.223274 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: X-User-Name: admin May 31 20:56:41.223274 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: method: > May 31 20:56:41.223274 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: exception: Flavor 84 could not be found. May 31 20:56:41.223274 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: action_args: {'id': '84'} May 31 20:56:41.223274 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: {{(pid=103579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 20:56:41.223274 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 20:56:41.224089 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 31 20:56:41.224089 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 31 20:56:41.224089 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 31 20:56:41.224089 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 31 20:56:41.224089 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 31 20:56:41.224089 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 31 20:56:41.224089 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 31 20:56:41.224089 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 31 20:56:41.224089 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 31 20:56:41.224089 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 20:56:41.224089 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 31 20:56:41.224089 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 31 20:56:41.224089 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 31 20:56:41.224089 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi May 31 20:56:41.224089 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 20:56:41.224089 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi May 31 20:56:41.224089 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 20:56:41.224089 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 20:56:41.224089 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 20:56:41.225123 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 20:56:41.225123 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 20:56:41.225123 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 20:56:41.225123 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 20:56:41.225123 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 31 20:56:41.225123 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 31 20:56:41.225123 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 31 20:56:41.225123 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi May 31 20:56:41.225123 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 20:56:41.225123 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi May 31 20:56:41.225123 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 20:56:41.225123 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 20:56:41.225123 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 20:56:41.225123 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 20:56:41.225123 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 20:56:41.225123 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 31 20:56:41.225123 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi May 31 20:56:41.225123 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi [None req-ddb77eaa-e7ba-4a98-9aeb-84263de54a56 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103579) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 20:56:41.226494 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: INFO nova.api.openstack.requestlog [None req-ddb77eaa-e7ba-4a98-9aeb-84263de54a56 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012405 May 31 20:56:41.226494 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: [pid: 103579|app: 0|req: 23/47] 10.222.0.55 () {60 vars in 1190 bytes} [Tue May 31 20:56:41 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 31 20:56:42.096782 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi [None req-7f6be0b7-a055-421f-934f-ae247937cfd0 admin admin] Calling method '>' {{(pid=103580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 20:56:42.097811 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: INFO nova.api.openstack.requestlog [None req-7f6be0b7-a055-421f-934f-ae247937cfd0 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 May 31 20:56:42.098260 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: [pid: 103580|app: 0|req: 25/48] 10.222.0.55 () {56 vars in 1074 bytes} [Tue May 31 20:56:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 20:56:42.286261 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi [None req-26d868d5-9924-44f9-a6b9-7432a96719b2 admin admin] Calling method '>' {{(pid=103579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 20:56:42.292088 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: INFO nova.api.openstack.wsgi [None req-26d868d5-9924-44f9-a6b9-7432a96719b2 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 31 20:56:42.294025 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi [None req-26d868d5-9924-44f9-a6b9-7432a96719b2 admin admin] Request method failure captured: May 31 20:56:42.294025 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 31 20:56:42.294025 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: Accept: application/json May 31 20:56:42.294025 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: Accept-Encoding: gzip, deflate May 31 20:56:42.294025 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: Connection: keep-alive May 31 20:56:42.294025 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: Content-Length: 0 May 31 20:56:42.294025 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: Host: 10.222.0.55 May 31 20:56:42.294025 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: Openstack-Api-Version: compute 2.90 May 31 20:56:42.294025 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: Openstack-System-Scope: None May 31 20:56:42.294025 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: User-Agent: python-novaclient May 31 20:56:42.294025 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: X-Auth-Token: gAAAAABiloEKOoNyMS2zFrYOWYPCOsxFs2fAzTySByIEEi1tOGxqd5Pw8yaCHSgqHjMfadNSGQdWOOIWtZ_icBcFNKlw0mUJkUrDUYeWKvve95wiNE9_qj-8iOzWGf_oo-qJvx3aHutaQczw6mMLvNlWaNf4OwbEqE6HF4llSeu6lVWvY_d3T8Q May 31 20:56:42.294025 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: X-Domain-Id: None May 31 20:56:42.294025 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: X-Domain-Name: None May 31 20:56:42.294025 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: X-Identity-Status: Confirmed May 31 20:56:42.294025 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: X-Is-Admin-Project: True May 31 20:56:42.294025 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: X-Openstack-Nova-Api-Version: 2.90 May 31 20:56:42.294025 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: X-Project-Domain-Id: default May 31 20:56:42.294025 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: X-Project-Domain-Name: Default May 31 20:56:42.294025 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: X-Project-Id: f6a1a8d766964543bcc4e46371605ff7 May 31 20:56:42.294025 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: X-Project-Name: admin May 31 20:56:42.294025 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: X-Role: member,admin,reader May 31 20:56:42.294025 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: X-Roles: member,admin,reader May 31 20:56:42.296845 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/f6a1a8d766964543bcc4e46371605ff7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f6a1a8d766964543bcc4e46371605ff7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_f6a1a8d766964543bcc4e46371605ff7", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f6a1a8d766964543bcc4e46371605ff7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] May 31 20:56:42.296845 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: X-Tenant: admin May 31 20:56:42.296845 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: X-Tenant-Id: f6a1a8d766964543bcc4e46371605ff7 May 31 20:56:42.296845 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: X-Tenant-Name: admin May 31 20:56:42.296845 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: X-User: admin May 31 20:56:42.296845 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: X-User-Domain-Id: default May 31 20:56:42.296845 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: X-User-Domain-Name: Default May 31 20:56:42.296845 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: X-User-Id: 8f14392ec7e347fab1ef8b6cbe7e2488 May 31 20:56:42.296845 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: X-User-Name: admin May 31 20:56:42.296845 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: method: > May 31 20:56:42.296845 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: exception: Flavor 451 could not be found. May 31 20:56:42.296845 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: action_args: {'id': '451'} May 31 20:56:42.296845 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: {{(pid=103579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 20:56:42.296845 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 20:56:42.298528 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 31 20:56:42.298528 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 31 20:56:42.298528 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 31 20:56:42.298528 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 31 20:56:42.298528 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 31 20:56:42.298528 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 31 20:56:42.298528 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 31 20:56:42.298528 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 31 20:56:42.298528 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 31 20:56:42.298528 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 20:56:42.298528 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 31 20:56:42.298528 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 31 20:56:42.298528 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 31 20:56:42.298528 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi May 31 20:56:42.298528 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 20:56:42.298528 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi May 31 20:56:42.298528 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 20:56:42.298528 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 20:56:42.298528 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 20:56:42.300554 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 20:56:42.300554 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 20:56:42.300554 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 20:56:42.300554 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 20:56:42.300554 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 31 20:56:42.300554 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 31 20:56:42.300554 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 31 20:56:42.300554 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi May 31 20:56:42.300554 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 20:56:42.300554 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi May 31 20:56:42.300554 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 20:56:42.300554 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 20:56:42.300554 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 20:56:42.300554 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 20:56:42.300554 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 20:56:42.300554 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 31 20:56:42.300554 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: ERROR nova.api.openstack.wsgi May 31 20:56:42.300554 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi [None req-26d868d5-9924-44f9-a6b9-7432a96719b2 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103579) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 20:56:42.302636 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: INFO nova.api.openstack.requestlog [None req-26d868d5-9924-44f9-a6b9-7432a96719b2 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060599 May 31 20:56:42.302636 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: [pid: 103579|app: 0|req: 24/49] 10.222.0.55 () {60 vars in 1193 bytes} [Tue May 31 20:56:42 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 31 20:56:42.305601 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi [None req-8489f11d-6427-4b24-b541-85dc389adc1c admin admin] Calling method '>' {{(pid=103580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 20:56:42.319566 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: INFO nova.api.openstack.requestlog [None req-8489f11d-6427-4b24-b541-85dc389adc1c admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017598 May 31 20:56:42.320094 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: [pid: 103580|app: 0|req: 26/50] 10.222.0.55 () {60 vars in 1210 bytes} [Tue May 31 20:56:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 20:56:42.329507 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi [None req-ae4be019-4c9c-4e64-87c7-8fd33049240c admin admin] Calling method '>' {{(pid=103579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 20:56:42.343125 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: INFO nova.api.openstack.requestlog [None req-ae4be019-4c9c-4e64-87c7-8fd33049240c admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017171 May 31 20:56:42.343657 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: [pid: 103579|app: 0|req: 25/51] 10.222.0.55 () {60 vars in 1210 bytes} [Tue May 31 20:56:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 20:56:42.353041 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi [None req-f11c257c-6dc5-4e66-8589-c6bbb5514d1f admin admin] Calling method '>' {{(pid=103580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 20:56:42.359109 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: INFO nova.api.openstack.wsgi [None req-f11c257c-6dc5-4e66-8589-c6bbb5514d1f admin admin] HTTP exception thrown: Flavor 451 could not be found. May 31 20:56:42.360607 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi [None req-f11c257c-6dc5-4e66-8589-c6bbb5514d1f admin admin] Request method failure captured: May 31 20:56:42.360607 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 31 20:56:42.360607 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: Accept: application/json May 31 20:56:42.360607 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: Accept-Encoding: gzip, deflate May 31 20:56:42.360607 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: Connection: keep-alive May 31 20:56:42.360607 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: Content-Length: 0 May 31 20:56:42.360607 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: Host: 10.222.0.55 May 31 20:56:42.360607 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: Openstack-Api-Version: compute 2.90 May 31 20:56:42.360607 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: Openstack-System-Scope: None May 31 20:56:42.360607 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: User-Agent: python-novaclient May 31 20:56:42.360607 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: X-Auth-Token: gAAAAABiloEKOoNyMS2zFrYOWYPCOsxFs2fAzTySByIEEi1tOGxqd5Pw8yaCHSgqHjMfadNSGQdWOOIWtZ_icBcFNKlw0mUJkUrDUYeWKvve95wiNE9_qj-8iOzWGf_oo-qJvx3aHutaQczw6mMLvNlWaNf4OwbEqE6HF4llSeu6lVWvY_d3T8Q May 31 20:56:42.360607 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: X-Domain-Id: None May 31 20:56:42.360607 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: X-Domain-Name: None May 31 20:56:42.360607 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: X-Identity-Status: Confirmed May 31 20:56:42.360607 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: X-Is-Admin-Project: True May 31 20:56:42.360607 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: X-Openstack-Nova-Api-Version: 2.90 May 31 20:56:42.360607 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: X-Project-Domain-Id: default May 31 20:56:42.360607 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: X-Project-Domain-Name: Default May 31 20:56:42.360607 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: X-Project-Id: f6a1a8d766964543bcc4e46371605ff7 May 31 20:56:42.360607 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: X-Project-Name: admin May 31 20:56:42.360607 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: X-Role: member,admin,reader May 31 20:56:42.360607 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: X-Roles: member,admin,reader May 31 20:56:42.362153 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/f6a1a8d766964543bcc4e46371605ff7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f6a1a8d766964543bcc4e46371605ff7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_f6a1a8d766964543bcc4e46371605ff7", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f6a1a8d766964543bcc4e46371605ff7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] May 31 20:56:42.362153 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: X-Tenant: admin May 31 20:56:42.362153 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: X-Tenant-Id: f6a1a8d766964543bcc4e46371605ff7 May 31 20:56:42.362153 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: X-Tenant-Name: admin May 31 20:56:42.362153 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: X-User: admin May 31 20:56:42.362153 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: X-User-Domain-Id: default May 31 20:56:42.362153 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: X-User-Domain-Name: Default May 31 20:56:42.362153 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: X-User-Id: 8f14392ec7e347fab1ef8b6cbe7e2488 May 31 20:56:42.362153 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: X-User-Name: admin May 31 20:56:42.362153 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: method: > May 31 20:56:42.362153 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: exception: Flavor 451 could not be found. May 31 20:56:42.362153 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: action_args: {'id': '451'} May 31 20:56:42.362153 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: {{(pid=103580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 20:56:42.362153 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 20:56:42.363135 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 31 20:56:42.363135 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 31 20:56:42.363135 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 31 20:56:42.363135 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 31 20:56:42.363135 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 31 20:56:42.363135 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 31 20:56:42.363135 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 31 20:56:42.363135 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 31 20:56:42.363135 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 31 20:56:42.363135 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 20:56:42.363135 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 31 20:56:42.363135 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 31 20:56:42.363135 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 31 20:56:42.363135 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi May 31 20:56:42.363135 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 20:56:42.363135 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi May 31 20:56:42.363135 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 20:56:42.363135 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 20:56:42.363135 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 20:56:42.364385 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 20:56:42.364385 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 20:56:42.364385 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 20:56:42.364385 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 20:56:42.364385 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 31 20:56:42.364385 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 31 20:56:42.364385 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 31 20:56:42.364385 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi May 31 20:56:42.364385 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 20:56:42.364385 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi May 31 20:56:42.364385 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 20:56:42.364385 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 20:56:42.364385 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 20:56:42.364385 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 20:56:42.364385 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 20:56:42.364385 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 31 20:56:42.364385 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: ERROR nova.api.openstack.wsgi May 31 20:56:42.364385 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi [None req-f11c257c-6dc5-4e66-8589-c6bbb5514d1f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 20:56:42.365667 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: INFO nova.api.openstack.requestlog [None req-f11c257c-6dc5-4e66-8589-c6bbb5514d1f admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012681 May 31 20:56:42.365667 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: [pid: 103580|app: 0|req: 27/52] 10.222.0.55 () {60 vars in 1193 bytes} [Tue May 31 20:56:42 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 31 20:56:43.237506 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi [None req-ae4be019-4c9c-4e64-87c7-8fd33049240c admin admin] Calling method '>' {{(pid=103579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 20:56:43.238556 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: INFO nova.api.openstack.requestlog [None req-ae4be019-4c9c-4e64-87c7-8fd33049240c admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 May 31 20:56:43.238962 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: [pid: 103579|app: 0|req: 26/53] 10.222.0.55 () {56 vars in 1074 bytes} [Tue May 31 20:56:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 20:56:43.426402 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi [None req-4874579e-7dd0-45a2-ac06-89d821cf5a9d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 20:56:43.500220 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: INFO nova.api.openstack.requestlog [None req-4874579e-7dd0-45a2-ac06-89d821cf5a9d admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.124203 May 31 20:56:43.500711 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: [pid: 103580|app: 0|req: 28/54] 10.222.0.55 () {64 vars in 1235 bytes} [Tue May 31 20:56:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 20:56:44.367515 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi [None req-ae4be019-4c9c-4e64-87c7-8fd33049240c admin admin] Calling method '>' {{(pid=103579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 20:56:44.368587 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: INFO nova.api.openstack.requestlog [None req-ae4be019-4c9c-4e64-87c7-8fd33049240c admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 May 31 20:56:44.368987 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: [pid: 103579|app: 0|req: 27/55] 10.222.0.55 () {56 vars in 1074 bytes} [Tue May 31 20:56:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 20:56:44.564541 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi [None req-38e6f85f-86cd-42fb-8706-cca86977d0c7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 20:56:44.628630 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: INFO nova.api.openstack.requestlog [None req-38e6f85f-86cd-42fb-8706-cca86977d0c7 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.124779 May 31 20:56:44.629183 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: [pid: 103580|app: 0|req: 29/56] 10.222.0.55 () {64 vars in 1235 bytes} [Tue May 31 20:56:44 2022] POST /compute/v2.1/flavors => generated 405 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 20:56:45.487830 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi [None req-ae4be019-4c9c-4e64-87c7-8fd33049240c admin admin] Calling method '>' {{(pid=103579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 20:56:45.488910 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: INFO nova.api.openstack.requestlog [None req-ae4be019-4c9c-4e64-87c7-8fd33049240c admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 May 31 20:56:45.499859 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: [pid: 103579|app: 0|req: 28/57] 10.222.0.55 () {56 vars in 1074 bytes} [Tue May 31 20:56:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 20:56:45.674780 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi [None req-0f546a86-fb9a-4a20-9f08-c12356b6e223 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 20:56:45.742498 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: INFO nova.api.openstack.requestlog [None req-0f546a86-fb9a-4a20-9f08-c12356b6e223 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.119065 May 31 20:56:45.743048 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: [pid: 103580|app: 0|req: 30/58] 10.222.0.55 () {64 vars in 1235 bytes} [Tue May 31 20:56:45 2022] POST /compute/v2.1/flavors => generated 407 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 20:56:46.612821 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi [None req-ae4be019-4c9c-4e64-87c7-8fd33049240c admin admin] Calling method '>' {{(pid=103579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 20:56:46.613848 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: INFO nova.api.openstack.requestlog [None req-ae4be019-4c9c-4e64-87c7-8fd33049240c admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 May 31 20:56:46.614273 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: [pid: 103579|app: 0|req: 29/59] 10.222.0.55 () {56 vars in 1074 bytes} [Tue May 31 20:56:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 20:56:46.802161 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi [None req-bbff3a0a-166a-4b56-af72-933f7325519d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 20:56:46.906021 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: INFO nova.api.openstack.requestlog [None req-bbff3a0a-166a-4b56-af72-933f7325519d admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.155277 May 31 20:56:46.906497 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: [pid: 103580|app: 0|req: 31/60] 10.222.0.55 () {64 vars in 1235 bytes} [Tue May 31 20:56:46 2022] POST /compute/v2.1/flavors => generated 409 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 20:56:47.770114 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi [None req-ae4be019-4c9c-4e64-87c7-8fd33049240c admin admin] Calling method '>' {{(pid=103579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 20:56:47.771125 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: INFO nova.api.openstack.requestlog [None req-ae4be019-4c9c-4e64-87c7-8fd33049240c admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 May 31 20:56:47.771518 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: [pid: 103579|app: 0|req: 30/61] 10.222.0.55 () {56 vars in 1074 bytes} [Tue May 31 20:56:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 20:56:47.956284 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi [None req-88e26f26-9f37-4447-9e00-130ca9a03499 admin admin] Calling method '>' {{(pid=103580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 20:56:47.975657 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: INFO nova.api.openstack.requestlog [None req-88e26f26-9f37-4447-9e00-130ca9a03499 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070258 May 31 20:56:47.976192 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: [pid: 103580|app: 0|req: 32/62] 10.222.0.55 () {60 vars in 1202 bytes} [Tue May 31 20:56:47 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 20:57:49.922585 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi [None req-ae4be019-4c9c-4e64-87c7-8fd33049240c admin admin] Calling method '>' {{(pid=103579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 20:57:49.923743 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: INFO nova.api.openstack.requestlog [None req-ae4be019-4c9c-4e64-87c7-8fd33049240c admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 May 31 20:57:49.924030 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: [pid: 103579|app: 0|req: 31/63] 10.222.0.55 () {54 vars in 930 bytes} [Tue May 31 20:57:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 20:57:49.931893 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG dbcounter [-] [103580] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:57:49.984463 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi [None req-e37e5f0f-335e-4ab5-be86-ab2fd8c2cf54 admin admin] Calling method '>' {{(pid=103580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 20:57:50.004200 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: INFO nova.api.openstack.requestlog [None req-e37e5f0f-335e-4ab5-be86-ab2fd8c2cf54 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.074263 May 31 20:57:50.004737 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: [pid: 103580|app: 0|req: 33/64] 10.222.0.55 () {60 vars in 1291 bytes} [Tue May 31 20:57:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 20:57:50.025635 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG dbcounter [-] [103579] Writing DB stats nova_api:SELECT=14 {{(pid=103579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:57:50.029308 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi [None req-96866623-15d5-4b3a-bdd1-0de3b982398f admin admin] Calling method '>' {{(pid=103579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 20:57:50.036738 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: INFO nova.api.openstack.requestlog [None req-96866623-15d5-4b3a-bdd1-0de3b982398f admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012682 May 31 20:57:50.037256 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: [pid: 103579|app: 0|req: 32/65] 10.222.0.55 () {60 vars in 1282 bytes} [Tue May 31 20:57:50 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 20:57:50.048791 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi [None req-b25e0902-87b2-426e-a473-64dd4611c610 admin admin] Calling method '>' {{(pid=103580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 20:57:50.057664 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: INFO nova.api.openstack.requestlog [None req-b25e0902-87b2-426e-a473-64dd4611c610 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012544 May 31 20:57:50.058253 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: [pid: 103580|app: 0|req: 34/66] 10.222.0.55 () {60 vars in 1285 bytes} [Tue May 31 20:57:50 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 20:57:50.070469 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi [None req-665210fc-85b4-4330-b723-399fd9432a0c admin admin] Calling method '>' {{(pid=103579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 20:57:50.078774 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: INFO nova.api.openstack.requestlog [None req-665210fc-85b4-4330-b723-399fd9432a0c admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011939 May 31 20:57:50.079287 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: [pid: 103579|app: 0|req: 33/67] 10.222.0.55 () {60 vars in 1285 bytes} [Tue May 31 20:57:50 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 20:57:50.090503 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi [None req-2b0f1677-bae4-4a59-9544-e2d5f066ea0e admin admin] Calling method '>' {{(pid=103580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 20:57:50.098308 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: INFO nova.api.openstack.requestlog [None req-2b0f1677-bae4-4a59-9544-e2d5f066ea0e admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011305 May 31 20:57:50.098815 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: [pid: 103580|app: 0|req: 35/68] 10.222.0.55 () {60 vars in 1282 bytes} [Tue May 31 20:57:50 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:01:14.871686 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi [None req-665210fc-85b4-4330-b723-399fd9432a0c admin admin] Calling method '>' {{(pid=103579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:01:14.872826 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: INFO nova.api.openstack.requestlog [None req-665210fc-85b4-4330-b723-399fd9432a0c admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 May 31 21:01:14.874080 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: [pid: 103579|app: 0|req: 34/69] 10.222.0.55 () {56 vars in 1074 bytes} [Tue May 31 21:01:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:01:15.035969 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG dbcounter [-] [103580] Writing DB stats nova_api:SELECT=6 {{(pid=103580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:15.162094 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi [None req-c65abb3c-e3f2-4624-9cc7-be25d5d22c93 admin admin] Calling method '>' {{(pid=103580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:01:15.164429 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 31 21:01:15.164429 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: warnings.warn(msg) May 31 21:01:15.164661 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG oslo_concurrency.lockutils [None req-c65abb3c-e3f2-4624-9cc7-be25d5d22c93 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:01:15.164960 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG oslo_concurrency.lockutils [None req-c65abb3c-e3f2-4624-9cc7-be25d5d22c93 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:01:15.165792 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG oslo_concurrency.lockutils [None req-c65abb3c-e3f2-4624-9cc7-be25d5d22c93 admin admin] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:01:15.166265 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG oslo_concurrency.lockutils [None req-c65abb3c-e3f2-4624-9cc7-be25d5d22c93 admin admin] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:01:15.202430 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: INFO nova.api.openstack.requestlog [None req-c65abb3c-e3f2-4624-9cc7-be25d5d22c93 admin admin] 10.222.0.55 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.167824 May 31 21:01:15.203024 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: [pid: 103580|app: 0|req: 36/70] 10.222.0.55 () {60 vars in 1193 bytes} [Tue May 31 21:01:15 2022] GET /compute/v2.1/os-services => generated 794 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 21:01:16.127055 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi [None req-665210fc-85b4-4330-b723-399fd9432a0c admin admin] Calling method '>' {{(pid=103579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:01:16.128061 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: INFO nova.api.openstack.requestlog [None req-665210fc-85b4-4330-b723-399fd9432a0c admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 May 31 21:01:16.128461 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: [pid: 103579|app: 0|req: 35/71] 10.222.0.55 () {56 vars in 1074 bytes} [Tue May 31 21:01:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:01:16.332136 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi [None req-5e547ac2-80e7-41f3-b6fc-54b59a0f8b4c admin admin] Calling method '>' {{(pid=103580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:01:16.333298 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 31 21:01:16.333298 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: warnings.warn(msg) May 31 21:01:16.334559 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG oslo_concurrency.lockutils [None req-5e547ac2-80e7-41f3-b6fc-54b59a0f8b4c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:01:16.335327 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG oslo_concurrency.lockutils [None req-5e547ac2-80e7-41f3-b6fc-54b59a0f8b4c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:01:16.336658 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG oslo_concurrency.lockutils [None req-5e547ac2-80e7-41f3-b6fc-54b59a0f8b4c admin admin] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:01:16.337050 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG oslo_concurrency.lockutils [None req-5e547ac2-80e7-41f3-b6fc-54b59a0f8b4c admin admin] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:01:16.367989 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: INFO nova.api.openstack.requestlog [None req-5e547ac2-80e7-41f3-b6fc-54b59a0f8b4c admin admin] 10.222.0.55 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.098206 May 31 21:01:16.368785 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: [pid: 103580|app: 0|req: 37/72] 10.222.0.55 () {60 vars in 1193 bytes} [Tue May 31 21:01:16 2022] GET /compute/v2.1/os-services => generated 794 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 21:01:27.715053 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi [None req-665210fc-85b4-4330-b723-399fd9432a0c admin admin] Calling method '>' {{(pid=103579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:01:27.716116 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: INFO nova.api.openstack.requestlog [None req-665210fc-85b4-4330-b723-399fd9432a0c admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 May 31 21:01:27.721570 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: [pid: 103579|app: 0|req: 36/73] 10.222.0.55 () {56 vars in 1074 bytes} [Tue May 31 21:01:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:01:27.861666 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG dbcounter [-] [103580] Writing DB stats nova_cell0:SELECT=4 {{(pid=103580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:27.862425 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG dbcounter [-] [103580] Writing DB stats nova_cell1:SELECT=4 {{(pid=103580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:27.863046 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG dbcounter [-] [103580] Writing DB stats nova_api:SELECT=8 {{(pid=103580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:27.912134 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi [None req-b2244186-9174-41d8-987e-7cb00e94495a admin admin] Calling method '>' {{(pid=103580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:01:27.913338 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 31 21:01:27.913338 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: warnings.warn(msg) May 31 21:01:27.914557 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG oslo_concurrency.lockutils [None req-b2244186-9174-41d8-987e-7cb00e94495a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:01:27.914993 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG oslo_concurrency.lockutils [None req-b2244186-9174-41d8-987e-7cb00e94495a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:01:27.915775 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG oslo_concurrency.lockutils [None req-b2244186-9174-41d8-987e-7cb00e94495a admin admin] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:01:27.916198 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG oslo_concurrency.lockutils [None req-b2244186-9174-41d8-987e-7cb00e94495a admin admin] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:01:27.942607 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: INFO nova.api.openstack.requestlog [None req-b2244186-9174-41d8-987e-7cb00e94495a admin admin] 10.222.0.55 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.086356 May 31 21:01:27.943171 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: [pid: 103580|app: 0|req: 38/74] 10.222.0.55 () {60 vars in 1193 bytes} [Tue May 31 21:01:27 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:01:28.842101 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: DEBUG nova.api.openstack.wsgi [None req-665210fc-85b4-4330-b723-399fd9432a0c admin admin] Calling method '>' {{(pid=103579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:01:28.843709 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: INFO nova.api.openstack.requestlog [None req-665210fc-85b4-4330-b723-399fd9432a0c admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002074 May 31 21:01:28.844115 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: [pid: 103579|app: 0|req: 37/75] 10.222.0.55 () {56 vars in 1074 bytes} [Tue May 31 21:01:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:01:29.041595 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG nova.api.openstack.wsgi [None req-fdc97750-07db-42c0-baf4-ccaee38b8070 admin admin] Calling method '>' {{(pid=103580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:01:29.042811 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 31 21:01:29.042811 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: warnings.warn(msg) May 31 21:01:29.044038 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG oslo_concurrency.lockutils [None req-fdc97750-07db-42c0-baf4-ccaee38b8070 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:01:29.044566 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG oslo_concurrency.lockutils [None req-fdc97750-07db-42c0-baf4-ccaee38b8070 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:01:29.045345 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG oslo_concurrency.lockutils [None req-fdc97750-07db-42c0-baf4-ccaee38b8070 admin admin] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:01:29.046378 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: DEBUG oslo_concurrency.lockutils [None req-fdc97750-07db-42c0-baf4-ccaee38b8070 admin admin] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:01:29.068235 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: INFO nova.api.openstack.requestlog [None req-fdc97750-07db-42c0-baf4-ccaee38b8070 admin admin] 10.222.0.55 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.084831 May 31 21:01:29.068789 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: [pid: 103580|app: 0|req: 39/76] 10.222.0.55 () {60 vars in 1193 bytes} [Tue May 31 21:01:28 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:02:26.744225 dv-cinder-839793-16-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 31 21:02:26.745388 dv-cinder-839793-16-iscsi devstack@n-api.service[103578]: Tue May 31 21:02:26 2022 - graceful shutdown triggered... May 31 21:02:26.745852 dv-cinder-839793-16-iscsi devstack@n-api.service[103579]: Gracefully killing worker 1 (pid: 103579)... May 31 21:02:26.746265 dv-cinder-839793-16-iscsi devstack@n-api.service[103580]: Gracefully killing worker 2 (pid: 103580)... May 31 21:02:27.746036 dv-cinder-839793-16-iscsi devstack@n-api.service[103578]: worker 1 buried after 1 seconds May 31 21:02:27.746036 dv-cinder-839793-16-iscsi devstack@n-api.service[103578]: worker 2 buried after 1 seconds May 31 21:02:27.746036 dv-cinder-839793-16-iscsi devstack@n-api.service[103578]: goodbye to uWSGI. May 31 21:02:27.747737 dv-cinder-839793-16-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 31 21:02:27.748554 dv-cinder-839793-16-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 31 21:02:27.751661 dv-cinder-839793-16-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 31 21:02:27.771347 dv-cinder-839793-16-iscsi devstack@n-api.service[118171]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 31 21:02:27.792259 dv-cinder-839793-16-iscsi devstack@n-api.service[118171]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 31 21:02:27 2022] *** May 31 21:02:27.792259 dv-cinder-839793-16-iscsi devstack@n-api.service[118171]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 31 21:02:27.792259 dv-cinder-839793-16-iscsi devstack@n-api.service[118171]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 31 21:02:27.792259 dv-cinder-839793-16-iscsi devstack@n-api.service[118171]: nodename: dv-cinder-839793-16-iscsi May 31 21:02:27.792259 dv-cinder-839793-16-iscsi devstack@n-api.service[118171]: machine: x86_64 May 31 21:02:27.792259 dv-cinder-839793-16-iscsi devstack@n-api.service[118171]: clock source: unix May 31 21:02:27.792259 dv-cinder-839793-16-iscsi devstack@n-api.service[118171]: pcre jit disabled May 31 21:02:27.792259 dv-cinder-839793-16-iscsi devstack@n-api.service[118171]: detected number of CPU cores: 4 May 31 21:02:27.792259 dv-cinder-839793-16-iscsi devstack@n-api.service[118171]: current working directory: / May 31 21:02:27.792259 dv-cinder-839793-16-iscsi devstack@n-api.service[118171]: detected binary path: /usr/bin/uwsgi-core May 31 21:02:27.792259 dv-cinder-839793-16-iscsi devstack@n-api.service[118171]: your processes number limit is 47680 May 31 21:02:27.792259 dv-cinder-839793-16-iscsi devstack@n-api.service[118171]: your memory page size is 4096 bytes May 31 21:02:27.792259 dv-cinder-839793-16-iscsi devstack@n-api.service[118171]: detected max file descriptor number: 2048 May 31 21:02:27.792259 dv-cinder-839793-16-iscsi devstack@n-api.service[118171]: lock engine: pthread robust mutexes May 31 21:02:27.792259 dv-cinder-839793-16-iscsi devstack@n-api.service[118171]: thunder lock: enabled May 31 21:02:27.792259 dv-cinder-839793-16-iscsi devstack@n-api.service[118171]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 31 21:02:27.792259 dv-cinder-839793-16-iscsi devstack@n-api.service[118171]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 31 21:02:27.838569 dv-cinder-839793-16-iscsi devstack@n-api.service[118171]: Python main interpreter initialized at 0x562f8d70f9c0 May 31 21:02:27.838569 dv-cinder-839793-16-iscsi devstack@n-api.service[118171]: python threads support enabled May 31 21:02:27.838569 dv-cinder-839793-16-iscsi devstack@n-api.service[118171]: your server socket listen backlog is limited to 100 connections May 31 21:02:27.838569 dv-cinder-839793-16-iscsi devstack@n-api.service[118171]: your mercy for graceful operations on workers is 90 seconds May 31 21:02:27.838569 dv-cinder-839793-16-iscsi devstack@n-api.service[118171]: mapped 403077 bytes (393 KB) for 2 cores May 31 21:02:27.839258 dv-cinder-839793-16-iscsi devstack@n-api.service[118171]: *** Operational MODE: preforking *** May 31 21:02:27.839258 dv-cinder-839793-16-iscsi devstack@n-api.service[118171]: *** uWSGI is running in multiple interpreter mode *** May 31 21:02:27.839258 dv-cinder-839793-16-iscsi devstack@n-api.service[118171]: spawned uWSGI master process (pid: 118171) May 31 21:02:27.839173 dv-cinder-839793-16-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 31 21:02:27.840147 dv-cinder-839793-16-iscsi devstack@n-api.service[118171]: spawned uWSGI worker 1 (pid: 118184, cores: 1) May 31 21:02:27.840147 dv-cinder-839793-16-iscsi devstack@n-api.service[118171]: spawned uWSGI worker 2 (pid: 118185, cores: 1) May 31 21:02:27.840765 dv-cinder-839793-16-iscsi devstack@n-api.service[118171]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 31 21:02:29.123237 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 31 21:02:29.127341 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 31 21:02:29.989415 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 31 21:02:29.989415 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: from cryptography.utils import int_from_bytes May 31 21:02:29.989752 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 31 21:02:29.989752 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: from cryptography.utils import int_from_bytes May 31 21:02:29.991238 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 31 21:02:29.991238 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: from cryptography.utils import int_from_bytes May 31 21:02:29.991593 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 31 21:02:29.991593 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: from cryptography.utils import int_from_bytes May 31 21:02:32.484941 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 31 21:02:32.485607 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 31 21:02:32.485742 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 31 21:02:32.486137 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 31 21:02:32.486451 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 31 21:02:32.486796 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.487130 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.487457 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.487780 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.488117 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.488436 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.488765 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.489092 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.489426 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.489693 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.490043 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.490370 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839793-16-iscsi {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.490699 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.491016 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.491339 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.491671 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.491983 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.492313 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.492627 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.493136 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.495264 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.495264 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.495264 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.495264 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.495264 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.495975 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.495975 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.496303 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.496749 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.497127 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.497492 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839793-16-iscsi {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.497839 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.497839 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.498639 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.498639 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.499375 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.499375 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.500078 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.500078 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.500732 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.500732 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.500732 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.501773 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.501773 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.501773 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.502809 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.502809 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.502809 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.503549 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.503549 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.503549 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.504252 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.504252 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.504723 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.504723 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.505364 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.505364 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.507401 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.507401 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.507401 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.507401 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.507401 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.507401 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.507401 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.508960 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.508960 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.508960 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.508960 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.508960 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.510634 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.510634 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.510634 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.511334 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.55 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.511334 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.55 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.511334 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.512034 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.512034 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.512483 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.512483 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.512990 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.513216 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.513468 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.513681 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.514020 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.515154 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.515154 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.515154 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.515154 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.516238 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.516238 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.516238 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.516905 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.516905 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.517387 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.517387 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.517829 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.517829 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.518339 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.518598 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.518841 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.519082 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.519353 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.519660 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.519982 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.520311 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.520622 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.520926 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.521240 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.521546 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.521870 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.522200 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.522508 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.522836 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.523140 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.523552 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.523777 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.524059 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.524369 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.524672 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.524986 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.525438 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.525751 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.526596 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.526890 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.527199 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.527515 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.527818 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.528131 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.528433 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.528745 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.530096 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.530679 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.531019 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.531349 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.531710 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.532031 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.533594 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.533594 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.533594 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.533594 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.534747 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.534747 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.534747 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.534747 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.535889 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.535889 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.535889 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.535889 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.536795 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.536795 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.536795 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.537460 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.537460 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.537973 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.538217 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.538452 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.538678 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.539002 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.539338 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.539665 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.539970 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.540319 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.540664 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.540982 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.541343 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.541673 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.542015 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.542594 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.542916 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.543254 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.543599 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.544016 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.544252 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.544572 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.544893 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.545210 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.545529 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.545849 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.546392 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.546721 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.547041 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.547361 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.547685 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.548005 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.548325 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.548649 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.549025 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.549346 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.549663 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.550005 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.550325 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.550660 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.550980 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.551296 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.551640 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.551962 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.552344 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.552646 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.552958 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.553254 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.553569 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.553922 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.554227 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.554563 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.554878 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.555191 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.555521 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.555950 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.556581 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.556581 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.557075 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.557075 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.557576 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.557822 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.558201 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.558446 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.558710 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.558984 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.559324 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.559630 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.559958 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.560290 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.560614 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.560925 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.561241 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.561553 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.561864 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.562196 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.562516 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.562825 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.563134 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.563439 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.563751 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.564057 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.564386 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.564697 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.565010 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.565316 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.565625 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.566009 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.566415 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.566732 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.566990 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.567315 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.567643 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.567967 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.569357 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.569357 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.569357 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.569357 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.569985 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.569985 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.570369 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.570565 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.570757 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.571080 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.571400 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.571728 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.572041 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.572365 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.573332 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.573574 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.573918 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.574246 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.574568 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.574892 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.575206 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.575561 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.575833 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.576148 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.576580 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.576890 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.577108 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.577426 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.577755 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.578488 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.578901 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.579143 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.579438 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.579778 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.580119 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.580439 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.580756 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.581349 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.581669 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.582012 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.582335 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.582651 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.582965 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.583595 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.583595 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.584047 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.584273 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.584500 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.584876 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.585122 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.585436 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.585836 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.586144 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.586532 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.586952 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.587357 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.587357 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.587831 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.588057 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.589227 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.589553 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.589869 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.590208 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.590528 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.590886 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.591203 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.591569 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.591827 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.592153 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.592469 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.592792 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.593107 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.593553 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.593998 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.594164 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.594390 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.594693 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.595048 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.595309 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.595624 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.595960 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.596276 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.596592 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.596944 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.597209 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.597515 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.597833 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.598473 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.598811 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.599305 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.599631 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.599959 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.600286 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.600627 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.600958 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.601306 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.601618 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.601965 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.602279 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.602589 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.602906 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.608349 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.608349 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.608349 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.608349 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.608349 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.608349 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.608349 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.608349 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.609964 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.609964 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.609964 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.609964 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.609964 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.609964 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.609964 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.609964 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.611278 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.611278 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.611278 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.611278 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.611278 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.611278 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.611278 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.611278 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.612547 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.612547 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.612547 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.613040 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.613604 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.613604 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.613978 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.614302 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.614644 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.614989 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.615314 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.615648 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.615980 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.616310 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.616640 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.617394 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.617394 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.617773 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.618059 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.618302 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.618695 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.618882 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.619206 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.620117 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.620437 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.620756 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.621081 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.621408 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.621734 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.622096 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.622446 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.622776 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.623091 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.623656 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.623848 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.624032 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.624349 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.624672 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.625006 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.625416 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.625728 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.626077 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.626399 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.626711 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.627024 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.627351 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.627758 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.627927 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.628247 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.628557 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.628889 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.629202 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.629519 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.629833 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.630193 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.630513 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.630869 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.631255 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.631553 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.631869 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.632280 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.632526 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.632833 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.633155 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.633475 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.634058 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.634307 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.634566 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.634804 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.635098 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.635632 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.635893 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.636140 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.636363 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.636617 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.636953 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.637298 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.637699 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.638265 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.638265 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.638767 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.639035 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.639431 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.639681 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.639918 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.640165 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.640395 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.640697 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.641014 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.641574 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.641922 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.642518 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.642797 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.643037 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.643284 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.643506 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.643805 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.644304 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.644546 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.644848 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.645172 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.645786 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.645786 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.646797 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.646797 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.646797 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.647247 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.647404 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.647797 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.648158 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.648480 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.648823 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.649143 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.649492 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.649776 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.650177 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.650494 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.651404 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.651766 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.652170 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.652541 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.652908 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.653345 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.653711 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.654067 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.654497 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.654819 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.655146 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.655473 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.655891 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.656130 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.656444 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.656769 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.657087 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.657419 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.657861 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.658122 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.658434 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.658818 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.659077 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.659408 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.659732 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.660059 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.660489 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.660824 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.661156 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.661463 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.661795 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.662141 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.662453 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.662815 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.663093 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.663404 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.663807 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.664129 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.664526 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.664766 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.665514 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.665514 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.665857 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.666279 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.667096 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.667716 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.667918 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.668231 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.668572 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.669016 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.669635 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.669829 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.670201 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.670360 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.670718 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.671114 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.671422 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.671760 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.672111 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.672452 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.672776 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.673132 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.673986 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.674245 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.674781 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.674995 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.675219 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.675580 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.675905 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.676337 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.676587 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.676905 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.677267 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.677592 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.677923 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.678292 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.678721 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.678997 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.679471 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.679913 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.680231 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.680682 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.681526 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.681526 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.682489 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.682723 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.682932 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.683267 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.683609 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.683932 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.684267 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.684598 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.685016 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.686138 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.686138 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.686138 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.686837 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.686837 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.687097 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.687235 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.687554 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.687886 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.688462 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.688806 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.689133 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.689461 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.689785 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.690134 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.690461 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.690785 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.691106 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.691426 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.691746 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.692094 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.692425 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.692765 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.693111 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.693443 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.693766 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.694116 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.694447 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.694813 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.695170 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.695460 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.695784 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.698670 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.698670 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.698670 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.698670 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.698670 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.698670 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.699673 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.699673 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.699673 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.699673 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.700204 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.700430 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.700805 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.701187 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.702260 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.702596 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.703178 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.703509 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.703856 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.704195 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.704532 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.704870 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.705213 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.705543 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.706269 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.706471 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.706811 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.707132 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.707442 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.707778 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.708102 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.708420 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.708756 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.709078 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.709671 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.710060 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.710391 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.710727 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.710852 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 31 21:02:32.711271 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.711348 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 31 21:02:32.711438 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.711661 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 31 21:02:32.711765 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.712174 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 31 21:02:32.712432 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 31 21:02:32.712824 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.713208 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.713301 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.713540 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.713644 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.713861 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.714017 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.714222 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.714334 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.714533 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.714626 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.714855 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.714958 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.715181 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.715275 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.715510 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.715627 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.715777 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.715942 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.716097 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.716208 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.716419 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839793-16-iscsi {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.716522 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.716737 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.716841 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.717050 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.717160 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.717362 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.717472 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.717683 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.717794 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.718063 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.718394 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.718742 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.719422 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.719422 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.719611 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.719781 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.719904 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.720188 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.720440 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.720574 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.720655 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.720825 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.720959 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.721287 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.721461 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.721611 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.721771 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.721991 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.722150 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.722328 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.722523 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.722685 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.722818 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.722955 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.723097 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.723249 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.723378 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.723515 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.723768 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.723883 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839793-16-iscsi {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.724056 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.724171 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.724345 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.724506 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.724660 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.724762 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.724995 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.725196 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.725323 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.725507 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.725724 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.725836 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.726121 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.726229 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.726495 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.726616 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.727063 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.727173 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.727467 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.727713 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.727924 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.728180 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.728386 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.728625 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.728866 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.729079 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.729294 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.729534 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.729755 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.729755 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.730265 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.730499 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.730733 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.730966 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.731205 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.731448 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.731665 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.731967 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.732185 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.732399 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.732706 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.732934 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.733192 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.733360 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.733522 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.733672 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.733841 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.734034 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.734229 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.734393 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.734545 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.734545 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.734845 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.734995 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.735151 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.735310 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.735474 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.735646 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.736788 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.736963 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.737117 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.737270 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.737416 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.737651 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.737811 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.737969 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.738119 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.738279 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.738445 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.738584 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.738755 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.738920 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.739053 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.739200 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.739363 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.739537 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.739687 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.739816 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.739967 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.740136 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.740305 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.740451 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.740603 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.740773 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.55 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.740932 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.741068 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.55 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.741329 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.741502 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.741502 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.741765 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.742070 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.742228 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.742394 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.742627 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.742830 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.743016 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.743239 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.743454 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.743620 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.743716 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.743853 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.743951 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.744059 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.744160 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.744247 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.744858 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.745011 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.745126 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.745223 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.745324 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.745411 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.745411 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.745639 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.745790 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.745988 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.746123 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.746236 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.746381 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.746381 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.746683 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.746807 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.746895 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.746979 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.747091 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.747184 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.747296 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.747399 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.747490 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.747597 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.747685 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.747779 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.747864 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.748028 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.748122 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.748231 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.748332 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.748438 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.748532 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.748625 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.748717 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.748810 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.748902 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.748986 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.749084 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.749218 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.749369 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.749510 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.749657 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.749804 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.749974 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.750143 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.750347 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.750502 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.750636 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.750754 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.750875 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.751011 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.751011 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.751011 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.751011 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.751528 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.751528 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.751780 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.751956 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.752251 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.752402 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.752509 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.752610 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.752813 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.752927 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.753181 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.753292 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.753529 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.753640 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.753865 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.763107 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.763331 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.763474 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.763628 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.763628 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.763952 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.764128 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.764298 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.764481 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.764634 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.764765 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.764917 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.765060 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.765232 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.765382 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.765382 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.765658 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.765820 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.765992 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.766113 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.766245 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.766374 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.766512 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.766694 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.766865 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.767021 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.767178 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.767330 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.767497 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 21:02:32.767659 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.767809 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.767969 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.768150 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.768315 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.768467 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.768604 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.768755 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.768893 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.769044 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.769185 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.769344 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.769472 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.769606 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.769753 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.769925 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.770064 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.770248 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.770396 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.770543 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.770694 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.770842 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.770992 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.771130 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.771264 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.771416 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.771649 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.771812 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.771967 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.772154 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.772323 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.772477 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.772643 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.772800 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.772971 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.773120 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.773251 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.773371 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.773496 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.773614 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.773715 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.773835 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.773968 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.774055 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.774174 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.774298 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.774298 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.774544 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.774640 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.774715 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.774794 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.774890 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.774966 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.775036 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.775121 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.775201 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.775281 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.775364 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.775445 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.775517 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.775595 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.776176 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.776261 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.776357 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.776451 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.776544 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 31 21:02:32.776631 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.776631 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.776631 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.776631 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.776631 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.776631 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.776631 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.776631 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.777262 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.777262 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.777262 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.777262 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.777262 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.777262 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.777262 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.777262 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.777855 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.777855 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.777855 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.777855 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.778261 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.779279 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.779649 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.779985 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.780344 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.780673 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.781004 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.781330 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.781659 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.782323 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.782323 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.782709 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.783032 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.783514 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.783769 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.784211 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.784514 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.784916 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.785358 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.785705 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.786089 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.786532 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.786890 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.787284 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.787676 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.788004 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.788372 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.788776 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.789120 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.789515 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.789851 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.790302 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.790690 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.792372 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.792372 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.792686 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.792841 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.793064 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.793435 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.793791 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.794156 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.794752 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.795010 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.795388 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.795786 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.796180 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.796549 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.797099 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.797620 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.798273 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.798829 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.799414 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.799999 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.800549 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.801110 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.801656 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.802271 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.802817 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.803371 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.803917 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.804463 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.805027 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.805588 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.806190 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.806750 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.807354 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.807906 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.808480 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.809011 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.809480 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.809838 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.810250 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.810581 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.810915 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.811268 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.811592 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.811958 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.812258 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.812574 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.812890 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.813213 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.813535 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.813856 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.814268 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.814595 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.814914 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.815234 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.815548 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.815992 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.816195 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.816530 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.816842 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.817159 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.817481 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.817792 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.818135 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.818445 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.818757 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.819070 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.819377 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.819697 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.820004 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.820314 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.820624 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.820938 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.821250 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.821557 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.821870 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.822205 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.822570 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.822881 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.823209 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.823528 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.823836 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.824142 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.824473 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.824863 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.825088 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.825394 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.825704 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.826216 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.826388 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.826693 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.827007 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.827335 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.827639 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.827963 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.828269 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.828581 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.828903 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.829213 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.829528 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.829833 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.830205 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.831895 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.831895 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.831895 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.831895 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.832524 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.832524 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.832828 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.832985 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.833194 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO dbcounter [None req-55305337-940a-4893-b774-ca50c02bbe13 None None] Registered counter for database nova_api May 31 21:02:32.833370 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.833787 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.834146 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.834468 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.834785 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.835108 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.835424 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.835764 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.836092 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.836512 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.836822 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.837134 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.837443 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.837746 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.838636 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.838946 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.839265 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.839570 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.839882 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.840187 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.840604 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.840843 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.841148 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.841466 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.841774 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.842169 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.842481 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.842808 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.843115 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.843421 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.843720 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.844050 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.844370 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.844674 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.845015 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.845340 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.845721 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.846059 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.846367 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.846700 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.847004 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.847305 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.847980 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.848298 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.848608 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.848921 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.849227 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.849548 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.849854 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.850190 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.850553 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.850803 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.851458 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.851879 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.852207 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.852513 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.852819 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.853133 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.853449 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.853837 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.854670 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.854949 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.855265 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.855575 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.855870 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.856432 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.856600 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.856846 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.857127 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.857543 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.857864 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.858098 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_db.sqlalchemy.engines [None req-55305337-940a-4893-b774-ca50c02bbe13 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118185) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 31 21:02:32.858346 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.858578 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.858788 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.859095 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.859400 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.859712 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.860034 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.860354 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.860660 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.860973 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.861277 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.861583 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.861887 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.862218 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.862521 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.862826 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.863185 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.863496 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.863800 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.864126 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.864436 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.864742 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.865167 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.865459 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.866682 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.866682 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.866682 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.867419 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.867419 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.867715 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writer thread running {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 31 21:02:32.867874 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.867874 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.868307 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.868471 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.868660 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.868979 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.869294 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.869647 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.869976 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.870311 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.870608 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.870921 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.871234 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.871557 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.871879 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.872203 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.872509 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.872821 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.873133 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.873444 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.873755 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.874094 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.874406 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.874720 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.875030 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.875338 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.875650 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.875971 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.876282 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.876592 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.876904 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.877299 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.877539 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.877823 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.878146 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.878464 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.878775 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.879083 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.879522 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.879834 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.880146 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.880454 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.880765 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.881075 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.881392 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.881710 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.882038 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.882459 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.882770 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.883084 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.883424 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.883730 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.884034 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.884345 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.884673 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.885005 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.885318 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.885618 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.885971 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.886286 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.886669 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.887021 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.887335 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.887669 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.888056 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.888367 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.888679 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.889002 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.889324 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.889649 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.889977 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.890298 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.890609 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.890930 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.891255 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.891594 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.891913 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.892218 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.892541 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.892861 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.893172 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.893494 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.893978 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.894254 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.894565 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.894888 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.895212 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.895516 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.895852 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.896169 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.896476 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.896782 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.897110 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.897541 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.897764 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.898106 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.898418 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.898725 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.899029 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.899354 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.899684 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.900005 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.900345 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.901223 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.901548 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.901854 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.902208 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.902519 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.902828 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.903135 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.903442 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.903791 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.904100 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.904425 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.904756 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.905089 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.905484 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.905825 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.906184 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.906512 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.906832 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.907155 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.907466 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.907773 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.908084 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.908392 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.908701 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.909008 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.909317 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.909623 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.909959 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.910271 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.910635 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.910944 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.911266 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.911597 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.911998 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.912312 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.912621 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.912970 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.913277 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.913613 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.913960 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.914289 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.914622 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.914937 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.915258 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.915582 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.915899 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.916248 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.917093 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.917424 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.917728 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.918073 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.918387 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.918707 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.919027 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.919347 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.919926 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.920262 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.920580 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.920896 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.921211 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.921526 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.921843 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.922184 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.922497 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.922808 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.923117 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.923450 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.923798 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.924126 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.924467 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.924791 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.925106 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.925420 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.925735 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.926128 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.926453 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.926761 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.927075 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.927391 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.927707 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.928020 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.928332 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.928645 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.928958 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.929269 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.929580 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.929919 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.930240 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.930567 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.930921 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.931232 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.931547 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.932393 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.932719 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.933286 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.933535 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.context [None req-55305337-940a-4893-b774-ca50c02bbe13 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cc5ba698-8981-4abe-a800-db6251f99fd3(cell1) {{(pid=118185) load_cells /opt/stack/nova/nova/context.py:464}} May 31 21:02:32.933671 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.933951 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.934280 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.934605 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.934927 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.935245 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.935573 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.935881 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.936192 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.936511 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.936819 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.937125 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.937454 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.937764 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.938103 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.938253 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-55305337-940a-4893-b774-ca50c02bbe13 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:02:32.938453 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.938801 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.939302 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.939663 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.939988 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.940322 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.940661 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.940830 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-55305337-940a-4893-b774-ca50c02bbe13 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:02:32.940995 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.941285 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.941604 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.941933 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.942138 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-55305337-940a-4893-b774-ca50c02bbe13 None None] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:02:32.942248 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.942646 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.942874 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.943163 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.943470 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.943780 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.944090 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.944194 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-55305337-940a-4893-b774-ca50c02bbe13 None None] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:02:32.944396 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.944709 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.945017 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.945445 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.945758 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.946099 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.946412 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.946725 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.946832 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO dbcounter [None req-55305337-940a-4893-b774-ca50c02bbe13 None None] Registered counter for database nova_cell0 May 31 21:02:32.947032 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.947337 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.948268 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.948625 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.948948 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.949255 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.949568 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.950127 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.950265 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.950504 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.950812 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.951180 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.951509 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.951814 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO dbcounter [None req-55305337-940a-4893-b774-ca50c02bbe13 None None] Registered counter for database nova_cell1 May 31 21:02:32.951952 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.952119 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.952423 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.952732 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.953057 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.953371 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.953688 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.954064 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.954388 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.955027 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.955375 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.955616 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.956301 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.956763 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.956911 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.957151 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.957456 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.957784 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.960592 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.960592 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.960592 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.960592 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.960592 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.961044 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_db.sqlalchemy.engines [None req-55305337-940a-4893-b774-ca50c02bbe13 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118185) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 31 21:02:32.961157 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.961157 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.961157 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.961157 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.961157 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.961157 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.961762 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.961762 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.962019 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.962307 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_db.sqlalchemy.engines [None req-55305337-940a-4893-b774-ca50c02bbe13 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118185) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 31 21:02:32.962630 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.962796 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.962992 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.964131 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.964299 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.964593 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.965412 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.965412 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.965412 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.966167 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.966167 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.966420 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.966852 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.967454 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.967454 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.967746 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.968007 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.968299 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writer thread running {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 31 21:02:32.968448 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.968633 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.968968 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.969413 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.969840 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.970189 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.970528 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.970867 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.971200 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.971529 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.979457 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.979457 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.979457 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.979457 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.979457 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.979457 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.979457 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.979457 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.980680 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.980680 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.980680 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.980680 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.980680 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.980680 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.980680 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.980680 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.981465 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.981465 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.981465 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.981465 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.981465 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.981465 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.981465 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.981465 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.982428 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.982428 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.982428 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.982428 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.982428 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.982428 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.982428 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.982428 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.983153 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.983153 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.983153 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.983153 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.983492 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.983636 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.983955 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.984271 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.984581 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.984892 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.985204 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.985517 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.985848 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.986201 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.986517 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.986845 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.987167 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.987492 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.987810 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.988124 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.988454 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.988771 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.989174 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.989499 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.989828 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.990306 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.990470 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.990779 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.991112 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.991440 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.991753 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.992082 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.992408 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.992763 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.993081 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.993432 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.993761 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.994163 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.995030 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.995339 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 21:02:32.995591 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 31 21:02:33.057714 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO dbcounter [None req-d7758065-66c4-484d-9a21-945d7ab2ba06 None None] Registered counter for database nova_api May 31 21:02:33.081168 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_db.sqlalchemy.engines [None req-d7758065-66c4-484d-9a21-945d7ab2ba06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118184) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 31 21:02:33.093532 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writer thread running {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 31 21:02:33.165250 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writer thread running {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 31 21:02:33.183799 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO dbcounter [None req-55305337-940a-4893-b774-ca50c02bbe13 None None] Registered counter for database nova_cell0 May 31 21:02:33.195344 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_db.sqlalchemy.engines [None req-55305337-940a-4893-b774-ca50c02bbe13 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118185) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 31 21:02:33.201980 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writer thread running {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 31 21:02:33.202166 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.context [None req-d7758065-66c4-484d-9a21-945d7ab2ba06 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cc5ba698-8981-4abe-a800-db6251f99fd3(cell1) {{(pid=118184) load_cells /opt/stack/nova/nova/context.py:464}} May 31 21:02:33.210568 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d7758065-66c4-484d-9a21-945d7ab2ba06 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:02:33.212229 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d7758065-66c4-484d-9a21-945d7ab2ba06 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:02:33.213170 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d7758065-66c4-484d-9a21-945d7ab2ba06 None None] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:02:33.215387 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d7758065-66c4-484d-9a21-945d7ab2ba06 None None] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:02:33.217520 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO dbcounter [None req-d7758065-66c4-484d-9a21-945d7ab2ba06 None None] Registered counter for database nova_cell0 May 31 21:02:33.221792 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO dbcounter [None req-d7758065-66c4-484d-9a21-945d7ab2ba06 None None] Registered counter for database nova_cell1 May 31 21:02:33.232126 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_db.sqlalchemy.engines [None req-d7758065-66c4-484d-9a21-945d7ab2ba06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118184) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 31 21:02:33.234289 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_db.sqlalchemy.engines [None req-d7758065-66c4-484d-9a21-945d7ab2ba06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118184) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 31 21:02:33.236843 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writer thread running {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 31 21:02:33.518514 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writer thread running {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 31 21:02:33.518514 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO dbcounter [None req-d7758065-66c4-484d-9a21-945d7ab2ba06 None None] Registered counter for database nova_cell0 May 31 21:02:33.518514 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_db.sqlalchemy.engines [None req-d7758065-66c4-484d-9a21-945d7ab2ba06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118184) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 31 21:02:33.518514 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writer thread running {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 31 21:02:33.671842 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: WARNING keystonemiddleware.auth_token [None req-55305337-940a-4893-b774-ca50c02bbe13 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 31 21:02:33.681182 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: WARNING keystonemiddleware.auth_token [None req-55305337-940a-4893-b774-ca50c02bbe13 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 31 21:02:33.937068 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: WARNING keystonemiddleware.auth_token [None req-d7758065-66c4-484d-9a21-945d7ab2ba06 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 31 21:02:33.943437 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: WARNING keystonemiddleware.auth_token [None req-55305337-940a-4893-b774-ca50c02bbe13 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 31 21:02:33.945446 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: WARNING keystonemiddleware.auth_token [None req-d7758065-66c4-484d-9a21-945d7ab2ba06 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 31 21:02:33.955019 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: WARNING keystonemiddleware.auth_token [None req-55305337-940a-4893-b774-ca50c02bbe13 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 31 21:02:33.961155 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562f8d70f9c0 pid: 118185 (default app) May 31 21:02:34.205477 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: WARNING keystonemiddleware.auth_token [None req-d7758065-66c4-484d-9a21-945d7ab2ba06 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 31 21:02:34.212412 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: WARNING keystonemiddleware.auth_token [None req-d7758065-66c4-484d-9a21-945d7ab2ba06 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 31 21:02:34.218483 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x562f8d70f9c0 pid: 118184 (default app) May 31 21:03:15.444294 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_api:SELECT=3 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:15.446404 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell0:SELECT=3 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:15.447817 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell1:SELECT=3 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:15.448596 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell0:SELECT=3 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:17.083885 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-f5b6917d-0012-465f-944b-e453243221da tempest-VolumesSnapshotsTestJSON-385275356 tempest-VolumesSnapshotsTestJSON-385275356-project] Action: 'create', calling method: .version_select at 0x7fe7c2d19310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-627933283"}} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:03:17.352148 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_api:SELECT=3 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:17.353153 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell1:SELECT=3 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:17.353987 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell0:SELECT=3 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:17.354908 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell0:SELECT=3 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:19.004301 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-9c8ec227-837e-4075-8395-b2fa8685d493 tempest-VolumesGetTestJSON-280084597 tempest-VolumesGetTestJSON-280084597-project] Action: 'create', calling method: .version_select at 0x7fe7c2d1a310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1033160254", "metadata": {"Type": "work"}}} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:03:19.980215 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-f5b6917d-0012-465f-944b-e453243221da tempest-VolumesSnapshotsTestJSON-385275356 tempest-VolumesSnapshotsTestJSON-385275356-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 4.541082 May 31 21:03:19.988405 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 1/1] 10.222.0.55 () {60 vars in 1154 bytes} [Tue May 31 21:03:15 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 4552 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 31 21:03:20.236693 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-a922b04a-72a3-4880-895f-bb5416aa2de9 tempest-VolumesNegativeTest-662130392 tempest-VolumesNegativeTest-662130392-project] Action: 'create', calling method: .version_select at 0x7fe7c2be0280>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2032768825", "metadata": {"Type": "work"}}} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:03:20.252239 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-a922b04a-72a3-4880-895f-bb5416aa2de9 tempest-VolumesNegativeTest-662130392 tempest-VolumesNegativeTest-662130392-project] Request method failure captured: May 31 21:03:20.252239 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 31 21:03:20.252239 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Accept: application/json May 31 21:03:20.252239 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Accept-Encoding: identity May 31 21:03:20.252239 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Connection: close May 31 21:03:20.252239 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Content-Length: 122 May 31 21:03:20.252239 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Content-Type: application/json May 31 21:03:20.252239 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Host: 10.222.0.55 May 31 21:03:20.252239 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Openstack-System-Scope: None May 31 21:03:20.252239 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: User-Agent: python-urllib3/1.26.9 May 31 21:03:20.252239 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Auth-Token: gAAAAABiloKW95mH6vhNkQq_aHw477CQGUNdGd4XV2A78ku1DMLFIHi_adiuTPYHsDn6p5iq1zufU6ScFnGeIRInkxPDaAgccGY0cbgtPhitZdJ2cabt80rnLokrauc_u5e6p-pQGA8mBGNcDHi_heW6VrfMrXItBuBMBn9W9YayqmqwR0Nk5jA May 31 21:03:20.252239 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Domain-Id: None May 31 21:03:20.252239 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Domain-Name: None May 31 21:03:20.252239 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Identity-Status: Confirmed May 31 21:03:20.252239 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Is-Admin-Project: True May 31 21:03:20.252239 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Domain-Id: default May 31 21:03:20.252239 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Domain-Name: Default May 31 21:03:20.252239 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Id: 850d5d523656499e85e63dd1a5e72857 May 31 21:03:20.252239 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Name: tempest-VolumesNegativeTest-662130392 May 31 21:03:20.252239 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Role: member,reader May 31 21:03:20.252239 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Roles: member,reader May 31 21:03:20.253964 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/850d5d523656499e85e63dd1a5e72857"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/850d5d523656499e85e63dd1a5e72857"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_850d5d523656499e85e63dd1a5e72857", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/850d5d523656499e85e63dd1a5e72857"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] May 31 21:03:20.253964 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant: tempest-VolumesNegativeTest-662130392 May 31 21:03:20.253964 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant-Id: 850d5d523656499e85e63dd1a5e72857 May 31 21:03:20.253964 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant-Name: tempest-VolumesNegativeTest-662130392 May 31 21:03:20.253964 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User: tempest-VolumesNegativeTest-662130392-project May 31 21:03:20.253964 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Domain-Id: default May 31 21:03:20.253964 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Domain-Name: Default May 31 21:03:20.253964 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Id: b39d1cd331d846538ee5bd4a8170b5dc May 31 21:03:20.253964 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Name: tempest-VolumesNegativeTest-662130392-project May 31 21:03:20.253964 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: May 31 21:03:20.253964 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2032768825", "metadata": {"Type": "work"}}} May 31 21:03:20.253964 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: method: May 31 21:03:20.253964 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 31 21:03:20.254939 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-2032768825', 'metadata': {'Type': 'work'}}}} May 31 21:03:20.254939 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 21:03:20.254939 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:03:20.254939 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 31 21:03:20.254939 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 31 21:03:20.254939 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 31 21:03:20.254939 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise error May 31 21:03:20.254939 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 31 21:03:20.254939 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:03:20.254939 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 31 21:03:20.254939 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 31 21:03:20.254939 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:03:20.254939 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi On instance['volume']: May 31 21:03:20.254939 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi '#$%' May 31 21:03:20.254939 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:03:20.254939 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:03:20.254939 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:03:20.254939 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:03:20.254939 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:03:20.254939 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:03:20.254939 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 21:03:20.254939 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 21:03:20.256540 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 31 21:03:20.256540 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 31 21:03:20.256540 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 21:03:20.256540 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 21:03:20.256540 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 31 21:03:20.256540 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 31 21:03:20.256540 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 31 21:03:20.256540 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 31 21:03:20.256540 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 31 21:03:20.256540 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 31 21:03:20.256540 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 31 21:03:20.256540 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:03:20.256540 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:03:20.256540 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:03:20.256540 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:03:20.256540 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:03:20.256540 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:03:20.256540 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 31 21:03:20.256540 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 31 21:03:20.258857 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 31 21:03:20.258857 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:03:20.260163 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-a922b04a-72a3-4880-895f-bb5416aa2de9 tempest-VolumesNegativeTest-662130392 tempest-VolumesNegativeTest-662130392-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118185) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 21:03:20.261438 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-a922b04a-72a3-4880-895f-bb5416aa2de9 tempest-VolumesNegativeTest-662130392 tempest-VolumesNegativeTest-662130392-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.271193 May 31 21:03:20.262791 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 2/2] 10.222.0.55 () {60 vars in 1155 bytes} [Tue May 31 21:03:19 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 273 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 31 21:03:20.407807 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-ebcab5a0-06d0-4e40-83a1-0ca886492d4b tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2072256984", "imageRef": "21b89996-9e87-489d-8891-305f6c3d905a", "flavorRef": "452", "networks": [{"uuid": "c95b8c46-645b-48ca-b406-ceba2d03bd23"}]}} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:03:20.546640 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.network.neutron [None req-ebcab5a0-06d0-4e40-83a1-0ca886492d4b tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] validate_networks() for [('c95b8c46-645b-48ca-b406-ceba2d03bd23', None, None, None, None, None)] {{(pid=118185) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 21:03:20.594110 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-9c8ec227-837e-4075-8395-b2fa8685d493 tempest-VolumesGetTestJSON-280084597 tempest-VolumesGetTestJSON-280084597-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.247903 May 31 21:03:20.595465 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 1/3] 10.222.0.55 () {60 vars in 1155 bytes} [Tue May 31 21:03:17 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3251 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) May 31 21:03:20.605514 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-3c139876-ec85-4f0e-9ddc-186c5d916baf tempest-VolumesSnapshotsTestJSON-385275356 tempest-VolumesSnapshotsTestJSON-385275356-project] Calling method '.version_select at 0x7fe7c2be0310>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:20.675794 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-3c139876-ec85-4f0e-9ddc-186c5d916baf tempest-VolumesSnapshotsTestJSON-385275356 tempest-VolumesSnapshotsTestJSON-385275356-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/c122fa59-d244-4c72-b1c3-78c5f704a7a3" status: 200 len: 344 microversion: 2.1 time: 0.077981 May 31 21:03:20.676778 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 2/4] 10.222.0.55 () {58 vars in 1244 bytes} [Tue May 31 21:03:20 2022] GET /compute/v2.1/os-volumes/c122fa59-d244-4c72-b1c3-78c5f704a7a3 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:03:20.682155 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-020212e2-0f78-4ada-bf97-941a2f4ab05c tempest-VolumesNegativeTest-662130392 tempest-VolumesNegativeTest-662130392-project] Action: 'create', calling method: .version_select at 0x7fe7c2be0940>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1600324976", "metadata": {"Type": "work"}}} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:03:20.687810 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-020212e2-0f78-4ada-bf97-941a2f4ab05c tempest-VolumesNegativeTest-662130392 tempest-VolumesNegativeTest-662130392-project] Request method failure captured: May 31 21:03:20.687810 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 31 21:03:20.687810 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Accept: application/json May 31 21:03:20.687810 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Accept-Encoding: identity May 31 21:03:20.687810 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Connection: close May 31 21:03:20.687810 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Content-Length: 120 May 31 21:03:20.687810 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Content-Type: application/json May 31 21:03:20.687810 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Host: 10.222.0.55 May 31 21:03:20.687810 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Openstack-System-Scope: None May 31 21:03:20.687810 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: User-Agent: python-urllib3/1.26.9 May 31 21:03:20.687810 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Auth-Token: gAAAAABiloKW95mH6vhNkQq_aHw477CQGUNdGd4XV2A78ku1DMLFIHi_adiuTPYHsDn6p5iq1zufU6ScFnGeIRInkxPDaAgccGY0cbgtPhitZdJ2cabt80rnLokrauc_u5e6p-pQGA8mBGNcDHi_heW6VrfMrXItBuBMBn9W9YayqmqwR0Nk5jA May 31 21:03:20.687810 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Domain-Id: None May 31 21:03:20.687810 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Domain-Name: None May 31 21:03:20.687810 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Identity-Status: Confirmed May 31 21:03:20.687810 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Is-Admin-Project: True May 31 21:03:20.687810 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Domain-Id: default May 31 21:03:20.687810 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Domain-Name: Default May 31 21:03:20.687810 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Id: 850d5d523656499e85e63dd1a5e72857 May 31 21:03:20.687810 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Name: tempest-VolumesNegativeTest-662130392 May 31 21:03:20.687810 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Role: member,reader May 31 21:03:20.687810 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Roles: member,reader May 31 21:03:20.689169 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/850d5d523656499e85e63dd1a5e72857"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/850d5d523656499e85e63dd1a5e72857"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_850d5d523656499e85e63dd1a5e72857", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/850d5d523656499e85e63dd1a5e72857"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] May 31 21:03:20.689169 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant: tempest-VolumesNegativeTest-662130392 May 31 21:03:20.689169 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant-Id: 850d5d523656499e85e63dd1a5e72857 May 31 21:03:20.689169 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant-Name: tempest-VolumesNegativeTest-662130392 May 31 21:03:20.689169 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User: tempest-VolumesNegativeTest-662130392-project May 31 21:03:20.689169 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Domain-Id: default May 31 21:03:20.689169 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Domain-Name: Default May 31 21:03:20.689169 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Id: b39d1cd331d846538ee5bd4a8170b5dc May 31 21:03:20.689169 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Name: tempest-VolumesNegativeTest-662130392-project May 31 21:03:20.689169 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: May 31 21:03:20.689169 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1600324976", "metadata": {"Type": "work"}}} May 31 21:03:20.689169 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: method: May 31 21:03:20.689169 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 31 21:03:20.690008 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1600324976', 'metadata': {'Type': 'work'}}}} May 31 21:03:20.690008 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 21:03:20.690008 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:03:20.690008 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 31 21:03:20.690008 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 31 21:03:20.690008 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 31 21:03:20.690008 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise error May 31 21:03:20.690008 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 31 21:03:20.690008 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:03:20.690008 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 31 21:03:20.690008 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 31 21:03:20.690008 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:03:20.690008 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi On instance['volume']: May 31 21:03:20.690008 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi '0' May 31 21:03:20.690008 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:03:20.690008 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:03:20.690008 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:03:20.690008 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:03:20.690008 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:03:20.690008 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:03:20.690008 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 21:03:20.690008 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 21:03:20.691277 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 31 21:03:20.691277 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 31 21:03:20.691277 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 21:03:20.691277 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 21:03:20.691277 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 31 21:03:20.691277 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 31 21:03:20.691277 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 31 21:03:20.691277 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 31 21:03:20.691277 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 31 21:03:20.691277 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 31 21:03:20.691277 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 31 21:03:20.691277 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:03:20.691277 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:03:20.691277 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:03:20.691277 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:03:20.691277 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:03:20.691277 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:03:20.691277 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 31 21:03:20.691277 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 31 21:03:20.692367 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 31 21:03:20.692367 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:03:20.692367 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-020212e2-0f78-4ada-bf97-941a2f4ab05c tempest-VolumesNegativeTest-662130392 tempest-VolumesNegativeTest-662130392-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 21:03:20.692367 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-020212e2-0f78-4ada-bf97-941a2f4ab05c tempest-VolumesNegativeTest-662130392 tempest-VolumesNegativeTest-662130392-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010922 May 31 21:03:20.695156 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 3/5] 10.222.0.55 () {60 vars in 1155 bytes} [Tue May 31 21:03:20 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 31 21:03:20.700343 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-30677002-496d-4b62-9f93-cd784ed7f945 tempest-VolumesGetTestJSON-280084597 tempest-VolumesGetTestJSON-280084597-project] Calling method '.version_select at 0x7fe7c2b98790>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:20.763341 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-30677002-496d-4b62-9f93-cd784ed7f945 tempest-VolumesGetTestJSON-280084597 tempest-VolumesGetTestJSON-280084597-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/9bf1f0cf-cfcb-4dcc-93a5-d2f71b1d4014" status: 200 len: 353 microversion: 2.1 time: 0.065971 May 31 21:03:20.768090 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 4/6] 10.222.0.55 () {58 vars in 1244 bytes} [Tue May 31 21:03:20 2022] GET /compute/v2.1/os-volumes/9bf1f0cf-cfcb-4dcc-93a5-d2f71b1d4014 => generated 353 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:03:20.773532 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-d8014635-3eea-4b1e-91f5-0b75a2831837 tempest-VolumesNegativeTest-662130392 tempest-VolumesNegativeTest-662130392-project] Action: 'create', calling method: .version_select at 0x7fe7c2be0670>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1940187116", "metadata": {"Type": "work"}}} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:03:20.775907 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-d8014635-3eea-4b1e-91f5-0b75a2831837 tempest-VolumesNegativeTest-662130392 tempest-VolumesNegativeTest-662130392-project] Request method failure captured: May 31 21:03:20.775907 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 31 21:03:20.775907 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Accept: application/json May 31 21:03:20.775907 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Accept-Encoding: identity May 31 21:03:20.775907 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Connection: close May 31 21:03:20.775907 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Content-Length: 119 May 31 21:03:20.775907 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Content-Type: application/json May 31 21:03:20.775907 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Host: 10.222.0.55 May 31 21:03:20.775907 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Openstack-System-Scope: None May 31 21:03:20.775907 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: User-Agent: python-urllib3/1.26.9 May 31 21:03:20.775907 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Auth-Token: gAAAAABiloKW95mH6vhNkQq_aHw477CQGUNdGd4XV2A78ku1DMLFIHi_adiuTPYHsDn6p5iq1zufU6ScFnGeIRInkxPDaAgccGY0cbgtPhitZdJ2cabt80rnLokrauc_u5e6p-pQGA8mBGNcDHi_heW6VrfMrXItBuBMBn9W9YayqmqwR0Nk5jA May 31 21:03:20.775907 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Domain-Id: None May 31 21:03:20.775907 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Domain-Name: None May 31 21:03:20.775907 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Identity-Status: Confirmed May 31 21:03:20.775907 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Is-Admin-Project: True May 31 21:03:20.775907 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Domain-Id: default May 31 21:03:20.775907 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Domain-Name: Default May 31 21:03:20.775907 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Id: 850d5d523656499e85e63dd1a5e72857 May 31 21:03:20.775907 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Name: tempest-VolumesNegativeTest-662130392 May 31 21:03:20.775907 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Role: member,reader May 31 21:03:20.775907 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Roles: member,reader May 31 21:03:20.777426 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/850d5d523656499e85e63dd1a5e72857"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/850d5d523656499e85e63dd1a5e72857"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_850d5d523656499e85e63dd1a5e72857", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/850d5d523656499e85e63dd1a5e72857"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] May 31 21:03:20.777426 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant: tempest-VolumesNegativeTest-662130392 May 31 21:03:20.777426 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant-Id: 850d5d523656499e85e63dd1a5e72857 May 31 21:03:20.777426 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant-Name: tempest-VolumesNegativeTest-662130392 May 31 21:03:20.777426 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User: tempest-VolumesNegativeTest-662130392-project May 31 21:03:20.777426 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Domain-Id: default May 31 21:03:20.777426 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Domain-Name: Default May 31 21:03:20.777426 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Id: b39d1cd331d846538ee5bd4a8170b5dc May 31 21:03:20.777426 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Name: tempest-VolumesNegativeTest-662130392-project May 31 21:03:20.777426 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: May 31 21:03:20.777426 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1940187116", "metadata": {"Type": "work"}}} May 31 21:03:20.777426 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: method: May 31 21:03:20.777426 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 31 21:03:20.778465 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1940187116', 'metadata': {'Type': 'work'}}}} May 31 21:03:20.778465 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 21:03:20.778465 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:03:20.778465 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 31 21:03:20.778465 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 31 21:03:20.778465 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 31 21:03:20.778465 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise error May 31 21:03:20.778465 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 31 21:03:20.778465 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:03:20.778465 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 31 21:03:20.778465 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 31 21:03:20.778465 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:03:20.778465 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi On instance['volume']: May 31 21:03:20.778465 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi '' May 31 21:03:20.778465 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:03:20.778465 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:03:20.778465 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:03:20.778465 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:03:20.778465 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:03:20.778465 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:03:20.778465 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 21:03:20.778465 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 21:03:20.780099 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 31 21:03:20.780099 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 31 21:03:20.780099 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 21:03:20.780099 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 21:03:20.780099 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 31 21:03:20.780099 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 31 21:03:20.780099 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 31 21:03:20.780099 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 31 21:03:20.780099 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 31 21:03:20.780099 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 31 21:03:20.780099 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 31 21:03:20.780099 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:03:20.780099 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:03:20.780099 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:03:20.780099 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:03:20.780099 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:03:20.780099 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:03:20.780099 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 31 21:03:20.780099 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 31 21:03:20.781427 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 31 21:03:20.781427 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:03:20.795682 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-d8014635-3eea-4b1e-91f5-0b75a2831837 tempest-VolumesNegativeTest-662130392 tempest-VolumesNegativeTest-662130392-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 21:03:20.795682 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-d8014635-3eea-4b1e-91f5-0b75a2831837 tempest-VolumesNegativeTest-662130392 tempest-VolumesNegativeTest-662130392-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.015602 May 31 21:03:20.795682 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 5/7] 10.222.0.55 () {60 vars in 1155 bytes} [Tue May 31 21:03:20 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 31 21:03:20.803537 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-1e2099cb-8600-4854-9d87-8f22744a633e tempest-VolumesNegativeTest-662130392 tempest-VolumesNegativeTest-662130392-project] Calling method '.version_select at 0x7fe7c2b98940>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:20.840688 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.wsgi [None req-1e2099cb-8600-4854-9d87-8f22744a633e tempest-VolumesNegativeTest-662130392 tempest-VolumesNegativeTest-662130392-project] HTTP exception thrown: Volume tempest-invalid-2070117826 could not be found. May 31 21:03:20.845068 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-1e2099cb-8600-4854-9d87-8f22744a633e tempest-VolumesNegativeTest-662130392 tempest-VolumesNegativeTest-662130392-project] Request method failure captured: May 31 21:03:20.845068 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2070117826 HTTP/1.1 May 31 21:03:20.845068 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Accept: application/json May 31 21:03:20.845068 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Accept-Encoding: identity May 31 21:03:20.845068 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Connection: close May 31 21:03:20.845068 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Content-Length: 0 May 31 21:03:20.845068 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Content-Type: application/json May 31 21:03:20.845068 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Host: 10.222.0.55 May 31 21:03:20.845068 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Openstack-System-Scope: None May 31 21:03:20.845068 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: User-Agent: python-urllib3/1.26.9 May 31 21:03:20.845068 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Auth-Token: gAAAAABiloKW95mH6vhNkQq_aHw477CQGUNdGd4XV2A78ku1DMLFIHi_adiuTPYHsDn6p5iq1zufU6ScFnGeIRInkxPDaAgccGY0cbgtPhitZdJ2cabt80rnLokrauc_u5e6p-pQGA8mBGNcDHi_heW6VrfMrXItBuBMBn9W9YayqmqwR0Nk5jA May 31 21:03:20.845068 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Domain-Id: None May 31 21:03:20.845068 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Domain-Name: None May 31 21:03:20.845068 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Identity-Status: Confirmed May 31 21:03:20.845068 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Is-Admin-Project: True May 31 21:03:20.845068 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Domain-Id: default May 31 21:03:20.845068 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Domain-Name: Default May 31 21:03:20.845068 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Id: 850d5d523656499e85e63dd1a5e72857 May 31 21:03:20.845068 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Name: tempest-VolumesNegativeTest-662130392 May 31 21:03:20.845068 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Role: member,reader May 31 21:03:20.845068 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Roles: member,reader May 31 21:03:20.846531 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/850d5d523656499e85e63dd1a5e72857"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/850d5d523656499e85e63dd1a5e72857"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_850d5d523656499e85e63dd1a5e72857", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/850d5d523656499e85e63dd1a5e72857"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] May 31 21:03:20.846531 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant: tempest-VolumesNegativeTest-662130392 May 31 21:03:20.846531 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant-Id: 850d5d523656499e85e63dd1a5e72857 May 31 21:03:20.846531 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant-Name: tempest-VolumesNegativeTest-662130392 May 31 21:03:20.846531 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User: tempest-VolumesNegativeTest-662130392-project May 31 21:03:20.846531 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Domain-Id: default May 31 21:03:20.846531 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Domain-Name: Default May 31 21:03:20.846531 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Id: b39d1cd331d846538ee5bd4a8170b5dc May 31 21:03:20.846531 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Name: tempest-VolumesNegativeTest-662130392-project May 31 21:03:20.846531 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: method: May 31 21:03:20.846531 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: exception: Volume tempest-invalid-2070117826 could not be found. May 31 21:03:20.846531 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: action_args: {'id': 'tempest-invalid-2070117826'} May 31 21:03:20.846531 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 21:03:20.847329 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:03:20.847329 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 31 21:03:20.847329 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 31 21:03:20.847329 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 31 21:03:20.847329 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 31 21:03:20.847329 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 31 21:03:20.847329 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 31 21:03:20.847329 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 31 21:03:20.847329 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 31 21:03:20.847329 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 31 21:03:20.847329 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 31 21:03:20.847329 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 31 21:03:20.847329 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 31 21:03:20.847329 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 31 21:03:20.847329 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 31 21:03:20.847329 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2070117826 could not be found. (HTTP 404) (Request-ID: req-f492d068-aad1-4073-869f-0f6a08ec7ff3) May 31 21:03:20.847329 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:03:20.847329 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:03:20.847329 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:03:21.124979 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:03:21.124979 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 31 21:03:21.124979 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 31 21:03:21.124979 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 31 21:03:21.124979 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 31 21:03:21.124979 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 31 21:03:21.124979 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 31 21:03:21.124979 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 31 21:03:21.124979 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 31 21:03:21.124979 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 31 21:03:21.124979 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 31 21:03:21.124979 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 31 21:03:21.124979 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 31 21:03:21.124979 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 31 21:03:21.124979 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 31 21:03:21.124979 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 31 21:03:21.124979 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 31 21:03:21.124979 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 31 21:03:21.124979 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 31 21:03:21.130239 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 31 21:03:21.130239 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 31 21:03:21.130239 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 31 21:03:21.130239 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 31 21:03:21.130239 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2070117826 could not be found. May 31 21:03:21.130239 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:03:21.130239 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:03:21.130239 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:03:21.130239 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:03:21.130239 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:03:21.130239 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:03:21.130239 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 21:03:21.130239 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 21:03:21.130239 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 31 21:03:21.130239 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 31 21:03:21.130239 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 21:03:21.130239 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 21:03:21.130239 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 31 21:03:21.130239 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 21:03:21.130239 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2070117826 could not be found. May 31 21:03:21.133742 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:03:21.133742 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:03:21.133742 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:03:21.133742 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:03:21.133742 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:03:21.133742 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:03:21.133742 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 21:03:21.133742 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 21:03:21.133742 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2070117826 could not be found. May 31 21:03:21.133742 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:03:21.133742 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-1e2099cb-8600-4854-9d87-8f22744a633e tempest-VolumesNegativeTest-662130392 tempest-VolumesNegativeTest-662130392-project] Returning 404 to user: Volume tempest-invalid-2070117826 could not be found. {{(pid=118184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 21:03:21.133742 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-1e2099cb-8600-4854-9d87-8f22744a633e tempest-VolumesNegativeTest-662130392 tempest-VolumesNegativeTest-662130392-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2070117826" status: 404 len: 99 microversion: 2.1 time: 0.053078 May 31 21:03:21.133742 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 6/8] 10.222.0.55 () {58 vars in 1217 bytes} [Tue May 31 21:03:20 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2070117826 => generated 99 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 31 21:03:21.136493 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-e8d00355-a7d2-4924-a04a-a8cee7ac9591 tempest-VolumesNegativeTest-662130392 tempest-VolumesNegativeTest-662130392-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.020567 May 31 21:03:21.136493 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 7/9] 10.222.0.55 () {58 vars in 1139 bytes} [Tue May 31 21:03:20 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 25 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 31 21:03:21.136493 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-c3ad3088-7e7f-4f26-9ff6-f01117af69ea tempest-VolumesNegativeTest-662130392 tempest-VolumesNegativeTest-662130392-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004888 May 31 21:03:21.136493 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 8/10] 10.222.0.55 () {58 vars in 1136 bytes} [Tue May 31 21:03:20 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) May 31 21:03:21.136493 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-c1a6a959-5d63-43f0-93b3-330230684e1e tempest-VolumesNegativeTest-662130392 tempest-VolumesNegativeTest-662130392-project] Calling method '.version_select at 0x7fe7c2afe4c0>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:21.136493 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.wsgi [None req-c1a6a959-5d63-43f0-93b3-330230684e1e tempest-VolumesNegativeTest-662130392 tempest-VolumesNegativeTest-662130392-project] HTTP exception thrown: Volume 0becbc39-0032-44eb-8d69-8671111cd416 could not be found. May 31 21:03:21.136493 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-c1a6a959-5d63-43f0-93b3-330230684e1e tempest-VolumesNegativeTest-662130392 tempest-VolumesNegativeTest-662130392-project] Request method failure captured: May 31 21:03:21.138502 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: request: DELETE /compute/v2.1/os-volumes/0becbc39-0032-44eb-8d69-8671111cd416 HTTP/1.1 May 31 21:03:21.138502 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Accept: application/json May 31 21:03:21.138502 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Accept-Encoding: identity May 31 21:03:21.138502 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Connection: close May 31 21:03:21.138502 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Content-Length: 0 May 31 21:03:21.138502 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Content-Type: application/json May 31 21:03:21.138502 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Host: 10.222.0.55 May 31 21:03:21.138502 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Openstack-System-Scope: None May 31 21:03:21.138502 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: User-Agent: python-urllib3/1.26.9 May 31 21:03:21.138502 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Auth-Token: gAAAAABiloKW95mH6vhNkQq_aHw477CQGUNdGd4XV2A78ku1DMLFIHi_adiuTPYHsDn6p5iq1zufU6ScFnGeIRInkxPDaAgccGY0cbgtPhitZdJ2cabt80rnLokrauc_u5e6p-pQGA8mBGNcDHi_heW6VrfMrXItBuBMBn9W9YayqmqwR0Nk5jA May 31 21:03:21.138502 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Domain-Id: None May 31 21:03:21.138502 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Domain-Name: None May 31 21:03:21.138502 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Identity-Status: Confirmed May 31 21:03:21.138502 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Is-Admin-Project: True May 31 21:03:21.138502 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Domain-Id: default May 31 21:03:21.138502 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Domain-Name: Default May 31 21:03:21.138502 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Id: 850d5d523656499e85e63dd1a5e72857 May 31 21:03:21.138502 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Name: tempest-VolumesNegativeTest-662130392 May 31 21:03:21.138502 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Role: member,reader May 31 21:03:21.138502 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Roles: member,reader May 31 21:03:21.140219 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/850d5d523656499e85e63dd1a5e72857"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/850d5d523656499e85e63dd1a5e72857"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_850d5d523656499e85e63dd1a5e72857", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/850d5d523656499e85e63dd1a5e72857"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] May 31 21:03:21.140219 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant: tempest-VolumesNegativeTest-662130392 May 31 21:03:21.140219 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant-Id: 850d5d523656499e85e63dd1a5e72857 May 31 21:03:21.140219 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant-Name: tempest-VolumesNegativeTest-662130392 May 31 21:03:21.140219 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User: tempest-VolumesNegativeTest-662130392-project May 31 21:03:21.140219 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Domain-Id: default May 31 21:03:21.140219 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Domain-Name: Default May 31 21:03:21.140219 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Id: b39d1cd331d846538ee5bd4a8170b5dc May 31 21:03:21.140219 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Name: tempest-VolumesNegativeTest-662130392-project May 31 21:03:21.140219 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: method: May 31 21:03:21.140219 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: exception: Volume 0becbc39-0032-44eb-8d69-8671111cd416 could not be found. May 31 21:03:21.140219 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: action_args: {'id': '0becbc39-0032-44eb-8d69-8671111cd416'} May 31 21:03:21.140219 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 21:03:21.140822 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:03:21.140822 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 31 21:03:21.140822 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 31 21:03:21.140822 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 31 21:03:21.140822 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 31 21:03:21.140822 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 31 21:03:21.140822 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 31 21:03:21.140822 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 31 21:03:21.140822 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 31 21:03:21.140822 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 31 21:03:21.140822 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 31 21:03:21.140822 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 31 21:03:21.140822 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 31 21:03:21.140822 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 31 21:03:21.140822 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 31 21:03:21.140822 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0becbc39-0032-44eb-8d69-8671111cd416 could not be found. (HTTP 404) (Request-ID: req-357c932d-c33d-4fcf-b544-4f6fb62707b4) May 31 21:03:21.140822 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:03:21.140822 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:03:21.140822 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:03:21.141774 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:03:21.141774 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 31 21:03:21.141774 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 31 21:03:21.141774 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 31 21:03:21.141774 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 31 21:03:21.141774 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 31 21:03:21.141774 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 31 21:03:21.141774 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 31 21:03:21.141774 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 31 21:03:21.141774 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 31 21:03:21.141774 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 31 21:03:21.141774 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 31 21:03:21.141774 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 31 21:03:21.141774 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 31 21:03:21.141774 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 31 21:03:21.141774 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 31 21:03:21.141774 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 31 21:03:21.141774 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 31 21:03:21.141774 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 31 21:03:21.146859 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 31 21:03:21.146859 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 31 21:03:21.146859 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 31 21:03:21.146859 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 31 21:03:21.146859 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0becbc39-0032-44eb-8d69-8671111cd416 could not be found. May 31 21:03:21.146859 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:03:21.146859 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:03:21.146859 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:03:21.146859 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:03:21.146859 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:03:21.146859 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:03:21.146859 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 21:03:21.146859 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 21:03:21.146859 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 31 21:03:21.146859 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 31 21:03:21.146859 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 21:03:21.146859 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 21:03:21.146859 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 31 21:03:21.146859 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 21:03:21.148506 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0becbc39-0032-44eb-8d69-8671111cd416 could not be found. May 31 21:03:21.148506 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:03:21.148506 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:03:21.148506 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:03:21.148506 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:03:21.148506 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:03:21.148506 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:03:21.148506 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 21:03:21.148506 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 21:03:21.148506 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0becbc39-0032-44eb-8d69-8671111cd416 could not be found. May 31 21:03:21.148506 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:03:21.148506 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-c1a6a959-5d63-43f0-93b3-330230684e1e tempest-VolumesNegativeTest-662130392 tempest-VolumesNegativeTest-662130392-project] Returning 404 to user: Volume 0becbc39-0032-44eb-8d69-8671111cd416 could not be found. {{(pid=118184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 21:03:21.148506 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-c1a6a959-5d63-43f0-93b3-330230684e1e tempest-VolumesNegativeTest-662130392 tempest-VolumesNegativeTest-662130392-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/0becbc39-0032-44eb-8d69-8671111cd416" status: 404 len: 109 microversion: 2.1 time: 0.058523 May 31 21:03:21.148506 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 9/11] 10.222.0.55 () {58 vars in 1247 bytes} [Tue May 31 21:03:20 2022] DELETE /compute/v2.1/os-volumes/0becbc39-0032-44eb-8d69-8671111cd416 => generated 109 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 21:03:21.149845 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-03f09a4b-0028-4e19-9862-3c8acc7ec98a tempest-VolumesNegativeTest-662130392 tempest-VolumesNegativeTest-662130392-project] Calling method '.version_select at 0x7fe7c2b98c10>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:21.149845 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.wsgi [None req-03f09a4b-0028-4e19-9862-3c8acc7ec98a tempest-VolumesNegativeTest-662130392 tempest-VolumesNegativeTest-662130392-project] HTTP exception thrown: Volume 6ec51c19-fa5d-4426-b254-e063b22443f9 could not be found. May 31 21:03:21.149845 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-03f09a4b-0028-4e19-9862-3c8acc7ec98a tempest-VolumesNegativeTest-662130392 tempest-VolumesNegativeTest-662130392-project] Request method failure captured: May 31 21:03:21.149845 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: request: GET /compute/v2.1/os-volumes/6ec51c19-fa5d-4426-b254-e063b22443f9 HTTP/1.1 May 31 21:03:21.149845 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Accept: application/json May 31 21:03:21.149845 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Accept-Encoding: identity May 31 21:03:21.149845 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Connection: close May 31 21:03:21.149845 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Content-Length: 0 May 31 21:03:21.149845 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Content-Type: application/json May 31 21:03:21.149845 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Host: 10.222.0.55 May 31 21:03:21.149845 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Openstack-System-Scope: None May 31 21:03:21.149845 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: User-Agent: python-urllib3/1.26.9 May 31 21:03:21.149845 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Auth-Token: gAAAAABiloKW95mH6vhNkQq_aHw477CQGUNdGd4XV2A78ku1DMLFIHi_adiuTPYHsDn6p5iq1zufU6ScFnGeIRInkxPDaAgccGY0cbgtPhitZdJ2cabt80rnLokrauc_u5e6p-pQGA8mBGNcDHi_heW6VrfMrXItBuBMBn9W9YayqmqwR0Nk5jA May 31 21:03:21.149845 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Domain-Id: None May 31 21:03:21.149845 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Domain-Name: None May 31 21:03:21.149845 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Identity-Status: Confirmed May 31 21:03:21.149845 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Is-Admin-Project: True May 31 21:03:21.149845 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Domain-Id: default May 31 21:03:21.149845 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Domain-Name: Default May 31 21:03:21.149845 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Id: 850d5d523656499e85e63dd1a5e72857 May 31 21:03:21.149845 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Name: tempest-VolumesNegativeTest-662130392 May 31 21:03:21.149845 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Role: member,reader May 31 21:03:21.149845 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Roles: member,reader May 31 21:03:21.154055 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/850d5d523656499e85e63dd1a5e72857"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/850d5d523656499e85e63dd1a5e72857"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_850d5d523656499e85e63dd1a5e72857", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/850d5d523656499e85e63dd1a5e72857"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] May 31 21:03:21.154055 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant: tempest-VolumesNegativeTest-662130392 May 31 21:03:21.154055 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant-Id: 850d5d523656499e85e63dd1a5e72857 May 31 21:03:21.154055 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant-Name: tempest-VolumesNegativeTest-662130392 May 31 21:03:21.154055 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User: tempest-VolumesNegativeTest-662130392-project May 31 21:03:21.154055 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Domain-Id: default May 31 21:03:21.154055 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Domain-Name: Default May 31 21:03:21.154055 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Id: b39d1cd331d846538ee5bd4a8170b5dc May 31 21:03:21.154055 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Name: tempest-VolumesNegativeTest-662130392-project May 31 21:03:21.154055 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: method: May 31 21:03:21.154055 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: exception: Volume 6ec51c19-fa5d-4426-b254-e063b22443f9 could not be found. May 31 21:03:21.154055 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: action_args: {'id': '6ec51c19-fa5d-4426-b254-e063b22443f9'} May 31 21:03:21.154055 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 21:03:21.156197 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:03:21.156197 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 31 21:03:21.156197 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 31 21:03:21.156197 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 31 21:03:21.156197 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi item = cinderclient( May 31 21:03:21.156197 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 31 21:03:21.156197 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 31 21:03:21.156197 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 31 21:03:21.156197 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 31 21:03:21.156197 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 31 21:03:21.156197 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 31 21:03:21.156197 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 31 21:03:21.156197 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 31 21:03:21.156197 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 31 21:03:21.156197 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 31 21:03:21.156197 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6ec51c19-fa5d-4426-b254-e063b22443f9 could not be found. (HTTP 404) (Request-ID: req-3ad8098e-e7f9-4041-95ef-e0e612852804) May 31 21:03:21.156197 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:03:21.156197 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:03:21.156197 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:03:21.162471 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:03:21.162471 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 31 21:03:21.162471 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 31 21:03:21.162471 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 31 21:03:21.162471 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 31 21:03:21.162471 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 31 21:03:21.162471 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 31 21:03:21.162471 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 31 21:03:21.162471 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 31 21:03:21.162471 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 31 21:03:21.162471 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 31 21:03:21.162471 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 31 21:03:21.162471 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi item = cinderclient( May 31 21:03:21.162471 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 31 21:03:21.162471 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 31 21:03:21.162471 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 31 21:03:21.162471 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 31 21:03:21.162471 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 31 21:03:21.162471 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 31 21:03:21.164097 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 31 21:03:21.164097 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 31 21:03:21.164097 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 31 21:03:21.164097 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 31 21:03:21.164097 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6ec51c19-fa5d-4426-b254-e063b22443f9 could not be found. May 31 21:03:21.164097 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:03:21.164097 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:03:21.164097 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:03:21.164097 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:03:21.164097 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:03:21.164097 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:03:21.164097 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 21:03:21.164097 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 21:03:21.164097 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 31 21:03:21.164097 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 31 21:03:21.164097 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 21:03:21.164097 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 21:03:21.164097 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 31 21:03:21.164097 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 21:03:21.165877 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6ec51c19-fa5d-4426-b254-e063b22443f9 could not be found. May 31 21:03:21.165877 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:03:21.165877 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:03:21.165877 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:03:21.165877 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:03:21.165877 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:03:21.165877 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:03:21.165877 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 21:03:21.165877 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 21:03:21.165877 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6ec51c19-fa5d-4426-b254-e063b22443f9 could not be found. May 31 21:03:21.165877 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:03:21.165877 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-03f09a4b-0028-4e19-9862-3c8acc7ec98a tempest-VolumesNegativeTest-662130392 tempest-VolumesNegativeTest-662130392-project] Returning 404 to user: Volume 6ec51c19-fa5d-4426-b254-e063b22443f9 could not be found. {{(pid=118184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 21:03:21.165877 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-03f09a4b-0028-4e19-9862-3c8acc7ec98a tempest-VolumesNegativeTest-662130392 tempest-VolumesNegativeTest-662130392-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/6ec51c19-fa5d-4426-b254-e063b22443f9" status: 404 len: 109 microversion: 2.1 time: 0.080621 May 31 21:03:21.165877 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 10/12] 10.222.0.55 () {58 vars in 1244 bytes} [Tue May 31 21:03:20 2022] GET /compute/v2.1/os-volumes/6ec51c19-fa5d-4426-b254-e063b22443f9 => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 21:03:21.617362 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.virt.hardware [None req-ebcab5a0-06d0-4e40-83a1-0ca886492d4b tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Flavor limits 0:0:0 {{(pid=118185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 21:03:21.617933 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.virt.hardware [None req-ebcab5a0-06d0-4e40-83a1-0ca886492d4b tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Image limits 0:0:0 {{(pid=118185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 21:03:21.618453 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.virt.hardware [None req-ebcab5a0-06d0-4e40-83a1-0ca886492d4b tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Flavor pref 0:0:0 {{(pid=118185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 21:03:21.619327 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.virt.hardware [None req-ebcab5a0-06d0-4e40-83a1-0ca886492d4b tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Image pref 0:0:0 {{(pid=118185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 21:03:21.619987 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.virt.hardware [None req-ebcab5a0-06d0-4e40-83a1-0ca886492d4b tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 21:03:21.638340 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ebcab5a0-06d0-4e40-83a1-0ca886492d4b tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:21.639195 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ebcab5a0-06d0-4e40-83a1-0ca886492d4b tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:21.639994 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ebcab5a0-06d0-4e40-83a1-0ca886492d4b tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:21.640580 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ebcab5a0-06d0-4e40-83a1-0ca886492d4b tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:21.677578 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.quota [None req-ebcab5a0-06d0-4e40-83a1-0ca886492d4b tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Getting quotas for project 96f91ac37f864ed98a03f9082252e334. Resources: {'ram', 'cores', 'instances'} {{(pid=118185) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 21:03:21.685743 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.quota [None req-ebcab5a0-06d0-4e40-83a1-0ca886492d4b tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Getting quotas for user d5b358c38b5a44d798f7f53c4b318134 and project 96f91ac37f864ed98a03f9082252e334. Resources: {'ram', 'cores', 'instances'} {{(pid=118185) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 21:03:21.688435 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-f025a782-f170-4e30-b644-f98c18c841b8 tempest-VolumesSnapshotsTestJSON-385275356 tempest-VolumesSnapshotsTestJSON-385275356-project] Calling method '.version_select at 0x7fe7c2afeee0>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:21.712264 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-ebcab5a0-06d0-4e40-83a1-0ca886492d4b tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Going to run 1 instances... {{(pid=118185) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 21:03:21.712264 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-ebcab5a0-06d0-4e40-83a1-0ca886492d4b tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] [instance: 35c086d9-50bf-494a-90bb-694569f861a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='21b89996-9e87-489d-8891-305f6c3d905a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118185) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 21:03:21.769946 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-f025a782-f170-4e30-b644-f98c18c841b8 tempest-VolumesSnapshotsTestJSON-385275356 tempest-VolumesSnapshotsTestJSON-385275356-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/c122fa59-d244-4c72-b1c3-78c5f704a7a3" status: 200 len: 345 microversion: 2.1 time: 0.085068 May 31 21:03:21.776931 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 11/13] 10.222.0.55 () {58 vars in 1244 bytes} [Tue May 31 21:03:21 2022] GET /compute/v2.1/os-volumes/c122fa59-d244-4c72-b1c3-78c5f704a7a3 => generated 345 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 21:03:21.782579 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-374d5616-dedd-475d-8e05-d4b1c2de8dc0 tempest-VolumesGetTestJSON-280084597 tempest-VolumesGetTestJSON-280084597-project] Calling method '.version_select at 0x7fe7c2b084c0>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:21.867426 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-374d5616-dedd-475d-8e05-d4b1c2de8dc0 tempest-VolumesGetTestJSON-280084597 tempest-VolumesGetTestJSON-280084597-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/9bf1f0cf-cfcb-4dcc-93a5-d2f71b1d4014" status: 200 len: 354 microversion: 2.1 time: 0.089332 May 31 21:03:21.868306 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 12/14] 10.222.0.55 () {58 vars in 1244 bytes} [Tue May 31 21:03:21 2022] GET /compute/v2.1/os-volumes/9bf1f0cf-cfcb-4dcc-93a5-d2f71b1d4014 => generated 354 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:03:21.873556 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-8ee6866b-d831-45c7-bd02-f7ad4404fbe6 tempest-VolumesSnapshotsTestJSON-385275356 tempest-VolumesSnapshotsTestJSON-385275356-project] Action: 'create', calling method: .version_select at 0x7fe7c2afeee0>, body: {"snapshot": {"volume_id": "c122fa59-d244-4c72-b1c3-78c5f704a7a3", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1458095593"}} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:03:21.913593 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-ebcab5a0-06d0-4e40-83a1-0ca886492d4b tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.648918 May 31 21:03:21.914923 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 3/15] 10.222.0.55 () {60 vars in 1146 bytes} [Tue May 31 21:03:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 31 21:03:21.922418 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-bc20da65-656a-445d-959e-98faa5f50351 tempest-VolumesGetTestJSON-280084597 tempest-VolumesGetTestJSON-280084597-project] Calling method '.version_select at 0x7fe7c2231430>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:21.997801 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-bc20da65-656a-445d-959e-98faa5f50351 tempest-VolumesGetTestJSON-280084597 tempest-VolumesGetTestJSON-280084597-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/9bf1f0cf-cfcb-4dcc-93a5-d2f71b1d4014" status: 200 len: 354 microversion: 2.1 time: 0.077991 May 31 21:03:21.997801 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 4/16] 10.222.0.55 () {58 vars in 1244 bytes} [Tue May 31 21:03:21 2022] GET /compute/v2.1/os-volumes/9bf1f0cf-cfcb-4dcc-93a5-d2f71b1d4014 => generated 354 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:03:22.014940 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-55481866-1d7d-4cf2-96c2-c3fc236b9804 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:22.016372 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-55481866-1d7d-4cf2-96c2-c3fc236b9804 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] [instance: 35c086d9-50bf-494a-90bb-694569f861a8] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:03:22.187501 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-55481866-1d7d-4cf2-96c2-c3fc236b9804 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b358c38b5a44d798f7f53c4b318134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f91ac37f864ed98a03f9082252e334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:03:22.228017 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-55481866-1d7d-4cf2-96c2-c3fc236b9804 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] 10.222.0.55 "GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8" status: 200 len: 1215 microversion: 2.1 time: 0.230935 May 31 21:03:22.230853 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 5/17] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:03:21 2022] GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8 => generated 1215 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:03:22.237128 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-5177a040-3b49-41a6-9ac1-2ef617028bdc tempest-VolumesGetTestJSON-280084597 tempest-VolumesGetTestJSON-280084597-project] Calling method '.version_select at 0x7fe7c2aa6dc0>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:22.721881 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-8ee6866b-d831-45c7-bd02-f7ad4404fbe6 tempest-VolumesSnapshotsTestJSON-385275356 tempest-VolumesSnapshotsTestJSON-385275356-project] 10.222.0.55 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.852270 May 31 21:03:22.723071 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 13/18] 10.222.0.55 () {60 vars in 1161 bytes} [Tue May 31 21:03:21 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:03:22.734611 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-2dc9872e-3235-4d14-8361-334290d4ed63 tempest-VolumesSnapshotsTestJSON-385275356 tempest-VolumesSnapshotsTestJSON-385275356-project] Calling method '.version_select at 0x7fe7c2b98f70>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:23.018543 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-5177a040-3b49-41a6-9ac1-2ef617028bdc tempest-VolumesGetTestJSON-280084597 tempest-VolumesGetTestJSON-280084597-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/9bf1f0cf-cfcb-4dcc-93a5-d2f71b1d4014" status: 202 len: 0 microversion: 2.1 time: 0.786178 May 31 21:03:23.022827 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 6/19] 10.222.0.55 () {58 vars in 1247 bytes} [Tue May 31 21:03:22 2022] DELETE /compute/v2.1/os-volumes/9bf1f0cf-cfcb-4dcc-93a5-d2f71b1d4014 => generated 0 bytes in 788 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 21:03:23.034005 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-878f52fe-da1f-4526-8a20-4b384b69aaaa tempest-VolumesGetTestJSON-280084597 tempest-VolumesGetTestJSON-280084597-project] Calling method '.version_select at 0x7fe7c2264d30>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:23.067996 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-2dc9872e-3235-4d14-8361-334290d4ed63 tempest-VolumesSnapshotsTestJSON-385275356 tempest-VolumesSnapshotsTestJSON-385275356-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/f2d7f49b-5810-4650-aa20-9fcf3c2b35f2" status: 200 len: 287 microversion: 2.1 time: 0.336730 May 31 21:03:23.075048 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 14/20] 10.222.0.55 () {58 vars in 1250 bytes} [Tue May 31 21:03:22 2022] GET /compute/v2.1/os-snapshots/f2d7f49b-5810-4650-aa20-9fcf3c2b35f2 => generated 287 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:03:23.081566 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-9fa8fd60-be89-419b-942a-9224ce28439c tempest-VolumesSnapshotsTestJSON-385275356 tempest-VolumesSnapshotsTestJSON-385275356-project] Calling method '.version_select at 0x7fe7c2b08700>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:23.147892 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-878f52fe-da1f-4526-8a20-4b384b69aaaa tempest-VolumesGetTestJSON-280084597 tempest-VolumesGetTestJSON-280084597-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/9bf1f0cf-cfcb-4dcc-93a5-d2f71b1d4014" status: 200 len: 353 microversion: 2.1 time: 0.121433 May 31 21:03:23.156327 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 7/21] 10.222.0.55 () {58 vars in 1244 bytes} [Tue May 31 21:03:23 2022] GET /compute/v2.1/os-volumes/9bf1f0cf-cfcb-4dcc-93a5-d2f71b1d4014 => generated 353 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:03:23.249575 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-a5458a06-8763-4084-a3c3-c6a3c4aacaf1 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:23.261088 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-a5458a06-8763-4084-a3c3-c6a3c4aacaf1 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] [instance: 35c086d9-50bf-494a-90bb-694569f861a8] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:03:23.272509 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-9fa8fd60-be89-419b-942a-9224ce28439c tempest-VolumesSnapshotsTestJSON-385275356 tempest-VolumesSnapshotsTestJSON-385275356-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.195655 May 31 21:03:23.279705 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 15/22] 10.222.0.55 () {58 vars in 1139 bytes} [Tue May 31 21:03:23 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:03:23.289557 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-d648238b-db57-4e96-bb7a-c14eeb60e0ca tempest-VolumesSnapshotsTestJSON-385275356 tempest-VolumesSnapshotsTestJSON-385275356-project] Calling method '.version_select at 0x7fe7c2b98c10>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:23.421386 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-d648238b-db57-4e96-bb7a-c14eeb60e0ca tempest-VolumesSnapshotsTestJSON-385275356 tempest-VolumesSnapshotsTestJSON-385275356-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/f2d7f49b-5810-4650-aa20-9fcf3c2b35f2" status: 200 len: 287 microversion: 2.1 time: 0.140198 May 31 21:03:23.422335 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 16/23] 10.222.0.55 () {58 vars in 1250 bytes} [Tue May 31 21:03:23 2022] GET /compute/v2.1/os-snapshots/f2d7f49b-5810-4650-aa20-9fcf3c2b35f2 => generated 287 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:03:23.489637 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-a5458a06-8763-4084-a3c3-c6a3c4aacaf1 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b358c38b5a44d798f7f53c4b318134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f91ac37f864ed98a03f9082252e334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:03:23.520613 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-a5458a06-8763-4084-a3c3-c6a3c4aacaf1 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] 10.222.0.55 "GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8" status: 200 len: 1215 microversion: 2.1 time: 0.279055 May 31 21:03:23.527448 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 8/24] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:03:23 2022] GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8 => generated 1215 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:03:24.163512 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-adc04845-bcb6-43e7-b8a2-3e727566e964 tempest-VolumesGetTestJSON-280084597 tempest-VolumesGetTestJSON-280084597-project] Calling method '.version_select at 0x7fe7c2b08160>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:24.276412 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-adc04845-bcb6-43e7-b8a2-3e727566e964 tempest-VolumesGetTestJSON-280084597 tempest-VolumesGetTestJSON-280084597-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/9bf1f0cf-cfcb-4dcc-93a5-d2f71b1d4014" status: 200 len: 353 microversion: 2.1 time: 0.117508 May 31 21:03:24.277055 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 17/25] 10.222.0.55 () {58 vars in 1244 bytes} [Tue May 31 21:03:24 2022] GET /compute/v2.1/os-volumes/9bf1f0cf-cfcb-4dcc-93a5-d2f71b1d4014 => generated 353 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:03:24.433518 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-bf8c6742-e11f-43da-9213-b9b8328f5410 tempest-VolumesSnapshotsTestJSON-385275356 tempest-VolumesSnapshotsTestJSON-385275356-project] Calling method '.version_select at 0x7fe7c2242a60>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:24.546820 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-11870412-ae91-4004-8601-31c7799dad9f tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:24.548213 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-11870412-ae91-4004-8601-31c7799dad9f tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] [instance: 35c086d9-50bf-494a-90bb-694569f861a8] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:03:24.555438 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-bf8c6742-e11f-43da-9213-b9b8328f5410 tempest-VolumesSnapshotsTestJSON-385275356 tempest-VolumesSnapshotsTestJSON-385275356-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/f2d7f49b-5810-4650-aa20-9fcf3c2b35f2" status: 200 len: 287 microversion: 2.1 time: 0.125757 May 31 21:03:24.555982 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 9/26] 10.222.0.55 () {58 vars in 1250 bytes} [Tue May 31 21:03:24 2022] GET /compute/v2.1/os-snapshots/f2d7f49b-5810-4650-aa20-9fcf3c2b35f2 => generated 287 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:03:24.864640 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-11870412-ae91-4004-8601-31c7799dad9f tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b358c38b5a44d798f7f53c4b318134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f91ac37f864ed98a03f9082252e334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:03:24.893451 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-11870412-ae91-4004-8601-31c7799dad9f tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] 10.222.0.55 "GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8" status: 200 len: 1215 microversion: 2.1 time: 0.350780 May 31 21:03:24.896303 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 18/27] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:03:24 2022] GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8 => generated 1215 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:03:25.293346 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-a21de7d3-b62f-4a88-add4-06d1ddcef452 tempest-VolumesGetTestJSON-280084597 tempest-VolumesGetTestJSON-280084597-project] Calling method '.version_select at 0x7fe7c226e4c0>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:25.369132 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-a21de7d3-b62f-4a88-add4-06d1ddcef452 tempest-VolumesGetTestJSON-280084597 tempest-VolumesGetTestJSON-280084597-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/9bf1f0cf-cfcb-4dcc-93a5-d2f71b1d4014" status: 200 len: 353 microversion: 2.1 time: 0.084047 May 31 21:03:25.372731 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 10/28] 10.222.0.55 () {58 vars in 1244 bytes} [Tue May 31 21:03:25 2022] GET /compute/v2.1/os-volumes/9bf1f0cf-cfcb-4dcc-93a5-d2f71b1d4014 => generated 353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:03:25.566419 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-2a790407-9a0d-4bad-8390-5953a3d64b2f tempest-VolumesSnapshotsTestJSON-385275356 tempest-VolumesSnapshotsTestJSON-385275356-project] Calling method '.version_select at 0x7fe7c2afedc0>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:25.632098 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-2a790407-9a0d-4bad-8390-5953a3d64b2f tempest-VolumesSnapshotsTestJSON-385275356 tempest-VolumesSnapshotsTestJSON-385275356-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/f2d7f49b-5810-4650-aa20-9fcf3c2b35f2" status: 200 len: 287 microversion: 2.1 time: 0.069198 May 31 21:03:25.633399 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 19/29] 10.222.0.55 () {58 vars in 1250 bytes} [Tue May 31 21:03:25 2022] GET /compute/v2.1/os-snapshots/f2d7f49b-5810-4650-aa20-9fcf3c2b35f2 => generated 287 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:03:25.933387 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-a4f6e3b1-a1fd-4192-8ea6-672b35023581 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:25.948730 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-a4f6e3b1-a1fd-4192-8ea6-672b35023581 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] [instance: 35c086d9-50bf-494a-90bb-694569f861a8] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:03:25.975520 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a4f6e3b1-a1fd-4192-8ea6-672b35023581 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:25.976814 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a4f6e3b1-a1fd-4192-8ea6-672b35023581 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:25.980142 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a4f6e3b1-a1fd-4192-8ea6-672b35023581 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:25.981604 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a4f6e3b1-a1fd-4192-8ea6-672b35023581 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:26.387637 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-39142d3f-bd76-4cc8-8927-cd3ac48eb6d1 tempest-VolumesGetTestJSON-280084597 tempest-VolumesGetTestJSON-280084597-project] Calling method '.version_select at 0x7fe7c2ac8e50>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:26.408365 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-a4f6e3b1-a1fd-4192-8ea6-672b35023581 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b358c38b5a44d798f7f53c4b318134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f91ac37f864ed98a03f9082252e334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:03:26.440060 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-a4f6e3b1-a1fd-4192-8ea6-672b35023581 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] 10.222.0.55 "GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8" status: 200 len: 1219 microversion: 2.1 time: 0.522979 May 31 21:03:26.451532 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 11/30] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:03:25 2022] GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8 => generated 1219 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:03:26.516859 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-39142d3f-bd76-4cc8-8927-cd3ac48eb6d1 tempest-VolumesGetTestJSON-280084597 tempest-VolumesGetTestJSON-280084597-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/9bf1f0cf-cfcb-4dcc-93a5-d2f71b1d4014" status: 200 len: 353 microversion: 2.1 time: 0.135468 May 31 21:03:26.517636 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 20/31] 10.222.0.55 () {58 vars in 1244 bytes} [Tue May 31 21:03:26 2022] GET /compute/v2.1/os-volumes/9bf1f0cf-cfcb-4dcc-93a5-d2f71b1d4014 => generated 353 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:03:26.645187 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-9ac18b19-034e-49f3-a8ca-6d0bb0c2b542 tempest-VolumesSnapshotsTestJSON-385275356 tempest-VolumesSnapshotsTestJSON-385275356-project] Calling method '.version_select at 0x7fe7c19ee280>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:26.804663 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-9ac18b19-034e-49f3-a8ca-6d0bb0c2b542 tempest-VolumesSnapshotsTestJSON-385275356 tempest-VolumesSnapshotsTestJSON-385275356-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/f2d7f49b-5810-4650-aa20-9fcf3c2b35f2" status: 200 len: 287 microversion: 2.1 time: 0.163683 May 31 21:03:26.805244 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 12/32] 10.222.0.55 () {58 vars in 1250 bytes} [Tue May 31 21:03:26 2022] GET /compute/v2.1/os-snapshots/f2d7f49b-5810-4650-aa20-9fcf3c2b35f2 => generated 287 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:03:27.460877 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-c94865d1-25dd-45b6-a775-9d7f1944dd02 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:27.467590 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-c94865d1-25dd-45b6-a775-9d7f1944dd02 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] [instance: 35c086d9-50bf-494a-90bb-694569f861a8] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:03:27.476706 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c94865d1-25dd-45b6-a775-9d7f1944dd02 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:27.487818 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c94865d1-25dd-45b6-a775-9d7f1944dd02 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:27.488668 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c94865d1-25dd-45b6-a775-9d7f1944dd02 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:27.489303 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c94865d1-25dd-45b6-a775-9d7f1944dd02 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:27.529258 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-d6c9ce24-abd5-4f82-b81a-8135013f4b04 tempest-VolumesGetTestJSON-280084597 tempest-VolumesGetTestJSON-280084597-project] Calling method '.version_select at 0x7fe7c19eeca0>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:27.657872 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-d6c9ce24-abd5-4f82-b81a-8135013f4b04 tempest-VolumesGetTestJSON-280084597 tempest-VolumesGetTestJSON-280084597-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/9bf1f0cf-cfcb-4dcc-93a5-d2f71b1d4014" status: 200 len: 353 microversion: 2.1 time: 0.132443 May 31 21:03:27.662006 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 13/33] 10.222.0.55 () {58 vars in 1244 bytes} [Tue May 31 21:03:27 2022] GET /compute/v2.1/os-volumes/9bf1f0cf-cfcb-4dcc-93a5-d2f71b1d4014 => generated 353 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 21:03:27.816538 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-e58f9c08-896a-44aa-9525-78bd6f175931 tempest-VolumesSnapshotsTestJSON-385275356 tempest-VolumesSnapshotsTestJSON-385275356-project] Calling method '.version_select at 0x7fe7c19eeaf0>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:27.939585 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-e58f9c08-896a-44aa-9525-78bd6f175931 tempest-VolumesSnapshotsTestJSON-385275356 tempest-VolumesSnapshotsTestJSON-385275356-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/f2d7f49b-5810-4650-aa20-9fcf3c2b35f2" status: 200 len: 287 microversion: 2.1 time: 0.124179 May 31 21:03:27.939585 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 14/34] 10.222.0.55 () {58 vars in 1250 bytes} [Tue May 31 21:03:27 2022] GET /compute/v2.1/os-snapshots/f2d7f49b-5810-4650-aa20-9fcf3c2b35f2 => generated 287 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:03:28.007424 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-c94865d1-25dd-45b6-a775-9d7f1944dd02 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b358c38b5a44d798f7f53c4b318134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f91ac37f864ed98a03f9082252e334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:03:28.029491 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-c94865d1-25dd-45b6-a775-9d7f1944dd02 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] 10.222.0.55 "GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8" status: 200 len: 1211 microversion: 2.1 time: 0.572923 May 31 21:03:28.040730 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 21/35] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:03:27 2022] GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8 => generated 1211 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:03:28.674724 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-c2b3fb5d-8177-40c1-99a3-5a1335d7e5e4 tempest-VolumesGetTestJSON-280084597 tempest-VolumesGetTestJSON-280084597-project] Calling method '.version_select at 0x7fe7c2231280>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:28.796565 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-c2b3fb5d-8177-40c1-99a3-5a1335d7e5e4 tempest-VolumesGetTestJSON-280084597 tempest-VolumesGetTestJSON-280084597-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/9bf1f0cf-cfcb-4dcc-93a5-d2f71b1d4014" status: 200 len: 353 microversion: 2.1 time: 0.126124 May 31 21:03:28.797725 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 15/36] 10.222.0.55 () {58 vars in 1244 bytes} [Tue May 31 21:03:28 2022] GET /compute/v2.1/os-volumes/9bf1f0cf-cfcb-4dcc-93a5-d2f71b1d4014 => generated 353 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:03:28.953135 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-a93817f9-a957-4276-a838-b778d6ed2f26 tempest-VolumesSnapshotsTestJSON-385275356 tempest-VolumesSnapshotsTestJSON-385275356-project] Calling method '.version_select at 0x7fe7c2a31ee0>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:29.024191 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-a93817f9-a957-4276-a838-b778d6ed2f26 tempest-VolumesSnapshotsTestJSON-385275356 tempest-VolumesSnapshotsTestJSON-385275356-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/f2d7f49b-5810-4650-aa20-9fcf3c2b35f2" status: 200 len: 288 microversion: 2.1 time: 0.078249 May 31 21:03:29.025286 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 22/37] 10.222.0.55 () {58 vars in 1250 bytes} [Tue May 31 21:03:28 2022] GET /compute/v2.1/os-snapshots/f2d7f49b-5810-4650-aa20-9fcf3c2b35f2 => generated 288 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:03:29.035612 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-84f4a489-1865-4ea8-9fbd-ec1e417a525d tempest-VolumesSnapshotsTestJSON-385275356 tempest-VolumesSnapshotsTestJSON-385275356-project] Calling method '.version_select at 0x7fe7c2242670>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:29.054029 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-73afdee0-d21f-4c2c-be7e-57e5b496bbb4 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:29.055829 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-73afdee0-d21f-4c2c-be7e-57e5b496bbb4 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] [instance: 35c086d9-50bf-494a-90bb-694569f861a8] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:03:29.073275 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-73afdee0-d21f-4c2c-be7e-57e5b496bbb4 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:29.074886 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-73afdee0-d21f-4c2c-be7e-57e5b496bbb4 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:29.078078 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-73afdee0-d21f-4c2c-be7e-57e5b496bbb4 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:29.079594 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-73afdee0-d21f-4c2c-be7e-57e5b496bbb4 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:29.265465 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-73afdee0-d21f-4c2c-be7e-57e5b496bbb4 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b358c38b5a44d798f7f53c4b318134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f91ac37f864ed98a03f9082252e334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:03:29.277287 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-73afdee0-d21f-4c2c-be7e-57e5b496bbb4 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] 10.222.0.55 "GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8" status: 200 len: 1267 microversion: 2.1 time: 0.230630 May 31 21:03:29.278208 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-84f4a489-1865-4ea8-9fbd-ec1e417a525d tempest-VolumesSnapshotsTestJSON-385275356 tempest-VolumesSnapshotsTestJSON-385275356-project] 10.222.0.55 "DELETE /compute/v2.1/os-snapshots/f2d7f49b-5810-4650-aa20-9fcf3c2b35f2" status: 202 len: 0 microversion: 2.1 time: 0.246156 May 31 21:03:29.279157 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 16/38] 10.222.0.55 () {58 vars in 1253 bytes} [Tue May 31 21:03:29 2022] DELETE /compute/v2.1/os-snapshots/f2d7f49b-5810-4650-aa20-9fcf3c2b35f2 => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 31 21:03:29.281054 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 23/39] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:03:29 2022] GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8 => generated 1267 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:03:29.287241 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-cdaa04c7-c286-4db5-994d-2a82271e1f50 tempest-VolumesSnapshotsTestJSON-385275356 tempest-VolumesSnapshotsTestJSON-385275356-project] Calling method '.version_select at 0x7fe7c2242700>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:29.419449 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-cdaa04c7-c286-4db5-994d-2a82271e1f50 tempest-VolumesSnapshotsTestJSON-385275356 tempest-VolumesSnapshotsTestJSON-385275356-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/f2d7f49b-5810-4650-aa20-9fcf3c2b35f2" status: 200 len: 287 microversion: 2.1 time: 0.135799 May 31 21:03:29.424358 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 17/40] 10.222.0.55 () {58 vars in 1250 bytes} [Tue May 31 21:03:29 2022] GET /compute/v2.1/os-snapshots/f2d7f49b-5810-4650-aa20-9fcf3c2b35f2 => generated 287 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 21:03:29.828221 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-017cdb85-dfbd-4cfc-9bbf-3fc98be5f615 tempest-VolumesGetTestJSON-280084597 tempest-VolumesGetTestJSON-280084597-project] Calling method '.version_select at 0x7fe7c2a49550>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:29.887352 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.wsgi [None req-017cdb85-dfbd-4cfc-9bbf-3fc98be5f615 tempest-VolumesGetTestJSON-280084597 tempest-VolumesGetTestJSON-280084597-project] HTTP exception thrown: Volume 9bf1f0cf-cfcb-4dcc-93a5-d2f71b1d4014 could not be found. May 31 21:03:29.889420 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-017cdb85-dfbd-4cfc-9bbf-3fc98be5f615 tempest-VolumesGetTestJSON-280084597 tempest-VolumesGetTestJSON-280084597-project] Request method failure captured: May 31 21:03:29.889420 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: request: GET /compute/v2.1/os-volumes/9bf1f0cf-cfcb-4dcc-93a5-d2f71b1d4014 HTTP/1.1 May 31 21:03:29.889420 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Accept: application/json May 31 21:03:29.889420 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Accept-Encoding: identity May 31 21:03:29.889420 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Connection: close May 31 21:03:29.889420 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Content-Length: 0 May 31 21:03:29.889420 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Content-Type: application/json May 31 21:03:29.889420 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Host: 10.222.0.55 May 31 21:03:29.889420 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Openstack-System-Scope: None May 31 21:03:29.889420 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: User-Agent: python-urllib3/1.26.9 May 31 21:03:29.889420 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Auth-Token: gAAAAABiloKV5geeMIK7IXCG3GYtUWlKLmm-N4YUCNpZQRu987iRlreTM0IgH92iOb3weO5wk7lQCX49WT8sLJEiU7n_9hiBOb1X3Unu8_BwqY8Qph9HuGwOcewghRhajaCFXjk3wfHmhmtuaZtWiYVLCPZe_60aRRjTgJ5P64u1BbNHsxkIjZ8 May 31 21:03:29.889420 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Domain-Id: None May 31 21:03:29.889420 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Domain-Name: None May 31 21:03:29.889420 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Identity-Status: Confirmed May 31 21:03:29.889420 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Is-Admin-Project: True May 31 21:03:29.889420 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Domain-Id: default May 31 21:03:29.889420 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Domain-Name: Default May 31 21:03:29.889420 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Id: 514e3c731ce34db584cf832e0f95d1fe May 31 21:03:29.889420 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Name: tempest-VolumesGetTestJSON-280084597 May 31 21:03:29.889420 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Role: member,reader May 31 21:03:29.889420 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Roles: member,reader May 31 21:03:29.890821 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/514e3c731ce34db584cf832e0f95d1fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/514e3c731ce34db584cf832e0f95d1fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_514e3c731ce34db584cf832e0f95d1fe", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/514e3c731ce34db584cf832e0f95d1fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] May 31 21:03:29.890821 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant: tempest-VolumesGetTestJSON-280084597 May 31 21:03:29.890821 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant-Id: 514e3c731ce34db584cf832e0f95d1fe May 31 21:03:29.890821 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant-Name: tempest-VolumesGetTestJSON-280084597 May 31 21:03:29.890821 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User: tempest-VolumesGetTestJSON-280084597-project May 31 21:03:29.890821 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Domain-Id: default May 31 21:03:29.890821 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Domain-Name: Default May 31 21:03:29.890821 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Id: f8f62f4151e744018155322bc669d06b May 31 21:03:29.890821 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Name: tempest-VolumesGetTestJSON-280084597-project May 31 21:03:29.890821 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: method: May 31 21:03:29.890821 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: exception: Volume 9bf1f0cf-cfcb-4dcc-93a5-d2f71b1d4014 could not be found. May 31 21:03:29.890821 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: action_args: {'id': '9bf1f0cf-cfcb-4dcc-93a5-d2f71b1d4014'} May 31 21:03:29.890821 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 21:03:29.891476 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:03:29.891476 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 31 21:03:29.891476 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 31 21:03:29.891476 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 31 21:03:29.891476 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi item = cinderclient( May 31 21:03:29.891476 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 31 21:03:29.891476 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 31 21:03:29.891476 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 31 21:03:29.891476 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 31 21:03:29.891476 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 31 21:03:29.891476 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 31 21:03:29.891476 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 31 21:03:29.891476 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 31 21:03:29.891476 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 31 21:03:29.891476 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 31 21:03:29.891476 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9bf1f0cf-cfcb-4dcc-93a5-d2f71b1d4014 could not be found. (HTTP 404) (Request-ID: req-d6b2a48f-bce5-43eb-83e5-502762365a0f) May 31 21:03:29.891476 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:03:29.891476 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:03:29.891476 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:03:29.892344 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:03:29.892344 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 31 21:03:29.892344 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 31 21:03:29.892344 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 31 21:03:29.892344 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 31 21:03:29.892344 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 31 21:03:29.892344 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 31 21:03:29.892344 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 31 21:03:29.892344 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 31 21:03:29.892344 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 31 21:03:29.892344 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 31 21:03:29.892344 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 31 21:03:29.892344 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi item = cinderclient( May 31 21:03:29.892344 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 31 21:03:29.892344 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 31 21:03:29.892344 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 31 21:03:29.892344 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 31 21:03:29.892344 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 31 21:03:29.892344 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 31 21:03:29.893251 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 31 21:03:29.893251 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 31 21:03:29.893251 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 31 21:03:29.893251 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 31 21:03:29.893251 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9bf1f0cf-cfcb-4dcc-93a5-d2f71b1d4014 could not be found. May 31 21:03:29.893251 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:03:29.893251 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:03:29.893251 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:03:29.893251 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:03:29.893251 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:03:29.893251 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:03:29.893251 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 21:03:29.893251 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 21:03:29.893251 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 31 21:03:29.893251 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 31 21:03:29.893251 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 21:03:29.893251 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 21:03:29.893251 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 31 21:03:29.893251 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 21:03:29.894255 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9bf1f0cf-cfcb-4dcc-93a5-d2f71b1d4014 could not be found. May 31 21:03:29.894255 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:03:29.894255 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:03:29.894255 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:03:29.894255 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:03:29.894255 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:03:29.894255 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:03:29.894255 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 21:03:29.894255 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 21:03:29.894255 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9bf1f0cf-cfcb-4dcc-93a5-d2f71b1d4014 could not be found. May 31 21:03:29.894255 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:03:29.894255 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-017cdb85-dfbd-4cfc-9bbf-3fc98be5f615 tempest-VolumesGetTestJSON-280084597 tempest-VolumesGetTestJSON-280084597-project] Returning 404 to user: Volume 9bf1f0cf-cfcb-4dcc-93a5-d2f71b1d4014 could not be found. {{(pid=118184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 21:03:29.894255 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-017cdb85-dfbd-4cfc-9bbf-3fc98be5f615 tempest-VolumesGetTestJSON-280084597 tempest-VolumesGetTestJSON-280084597-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/9bf1f0cf-cfcb-4dcc-93a5-d2f71b1d4014" status: 404 len: 109 microversion: 2.1 time: 0.085553 May 31 21:03:29.894255 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 24/41] 10.222.0.55 () {58 vars in 1244 bytes} [Tue May 31 21:03:29 2022] GET /compute/v2.1/os-volumes/9bf1f0cf-cfcb-4dcc-93a5-d2f71b1d4014 => generated 109 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 21:03:30.322895 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-29f4867d-bd44-47d4-8dcc-5aecae85ec0d tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:30.326072 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-29f4867d-bd44-47d4-8dcc-5aecae85ec0d tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] [instance: 35c086d9-50bf-494a-90bb-694569f861a8] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:03:30.357228 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-29f4867d-bd44-47d4-8dcc-5aecae85ec0d tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:30.357710 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-29f4867d-bd44-47d4-8dcc-5aecae85ec0d tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:30.363303 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-29f4867d-bd44-47d4-8dcc-5aecae85ec0d tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:30.365341 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-29f4867d-bd44-47d4-8dcc-5aecae85ec0d tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:30.435045 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-50e3723b-b4ab-47c8-980e-7b83fe2f9392 tempest-VolumesSnapshotsTestJSON-385275356 tempest-VolumesSnapshotsTestJSON-385275356-project] Calling method '.version_select at 0x7fe7c2b988b0>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:30.517609 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.wsgi [None req-50e3723b-b4ab-47c8-980e-7b83fe2f9392 tempest-VolumesSnapshotsTestJSON-385275356 tempest-VolumesSnapshotsTestJSON-385275356-project] HTTP exception thrown: Snapshot f2d7f49b-5810-4650-aa20-9fcf3c2b35f2 could not be found. May 31 21:03:30.521687 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-50e3723b-b4ab-47c8-980e-7b83fe2f9392 tempest-VolumesSnapshotsTestJSON-385275356 tempest-VolumesSnapshotsTestJSON-385275356-project] Request method failure captured: May 31 21:03:30.521687 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: request: GET /compute/v2.1/os-snapshots/f2d7f49b-5810-4650-aa20-9fcf3c2b35f2 HTTP/1.1 May 31 21:03:30.521687 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Accept: application/json May 31 21:03:30.521687 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Accept-Encoding: identity May 31 21:03:30.521687 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Connection: close May 31 21:03:30.521687 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Content-Length: 0 May 31 21:03:30.521687 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Content-Type: application/json May 31 21:03:30.521687 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Host: 10.222.0.55 May 31 21:03:30.521687 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Openstack-System-Scope: None May 31 21:03:30.521687 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: User-Agent: python-urllib3/1.26.9 May 31 21:03:30.521687 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Auth-Token: gAAAAABiloKTlXRmEA3yjjhzHliYBVJ1lpHIqaY6iAx2CjBprs6UpMe3Oh6i1l02RPwcHUAta2kchDNqqb4fJEls_iQgZMmOP3ZCmTBBVQyoIXstbJ6pew1htyPAhgYTKcDIRojms4ar3GXkIYX7hRIcT7spbHVsmy9Bunn5XAeYPzm4RcsorhI May 31 21:03:30.521687 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Domain-Id: None May 31 21:03:30.521687 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Domain-Name: None May 31 21:03:30.521687 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Identity-Status: Confirmed May 31 21:03:30.521687 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Is-Admin-Project: True May 31 21:03:30.521687 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Domain-Id: default May 31 21:03:30.521687 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Domain-Name: Default May 31 21:03:30.521687 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Id: 979727d273dc44faa7861e084aea2022 May 31 21:03:30.521687 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-385275356 May 31 21:03:30.521687 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Role: member,reader May 31 21:03:30.521687 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Roles: member,reader May 31 21:03:30.523558 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/979727d273dc44faa7861e084aea2022"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/979727d273dc44faa7861e084aea2022"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_979727d273dc44faa7861e084aea2022", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/979727d273dc44faa7861e084aea2022"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] May 31 21:03:30.523558 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant: tempest-VolumesSnapshotsTestJSON-385275356 May 31 21:03:30.523558 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant-Id: 979727d273dc44faa7861e084aea2022 May 31 21:03:30.523558 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-385275356 May 31 21:03:30.523558 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User: tempest-VolumesSnapshotsTestJSON-385275356-project May 31 21:03:30.523558 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Domain-Id: default May 31 21:03:30.523558 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Domain-Name: Default May 31 21:03:30.523558 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Id: f1b9a99fb432495aa5f4d0402a7858ff May 31 21:03:30.523558 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Name: tempest-VolumesSnapshotsTestJSON-385275356-project May 31 21:03:30.523558 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: method: May 31 21:03:30.523558 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: exception: Snapshot f2d7f49b-5810-4650-aa20-9fcf3c2b35f2 could not be found. May 31 21:03:30.523558 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: action_args: {'id': 'f2d7f49b-5810-4650-aa20-9fcf3c2b35f2'} May 31 21:03:30.523558 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 21:03:30.524292 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:03:30.524292 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 31 21:03:30.524292 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 31 21:03:30.524292 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 31 21:03:30.524292 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 31 21:03:30.524292 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 31 21:03:30.524292 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 31 21:03:30.524292 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 31 21:03:30.524292 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 31 21:03:30.524292 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 31 21:03:30.524292 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 31 21:03:30.524292 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 31 21:03:30.524292 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 31 21:03:30.524292 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 31 21:03:30.524292 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 31 21:03:30.524292 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot f2d7f49b-5810-4650-aa20-9fcf3c2b35f2 could not be found. (HTTP 404) (Request-ID: req-04b346c7-8a07-4880-91bb-5445bf91bff9) May 31 21:03:30.524292 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:03:30.524292 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:03:30.525795 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:03:30.525795 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:03:30.525795 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 31 21:03:30.525795 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 31 21:03:30.525795 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 31 21:03:30.525795 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 31 21:03:30.525795 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 31 21:03:30.525795 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 31 21:03:30.525795 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 31 21:03:30.525795 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 31 21:03:30.525795 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 31 21:03:30.525795 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 31 21:03:30.525795 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 31 21:03:30.525795 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 31 21:03:30.525795 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 31 21:03:30.525795 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 31 21:03:30.525795 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 31 21:03:30.525795 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 31 21:03:30.525795 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 31 21:03:30.530937 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 31 21:03:30.530937 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 31 21:03:30.530937 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 31 21:03:30.530937 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 31 21:03:30.530937 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 31 21:03:30.530937 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot f2d7f49b-5810-4650-aa20-9fcf3c2b35f2 could not be found. May 31 21:03:30.530937 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:03:30.530937 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:03:30.530937 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:03:30.530937 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:03:30.530937 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:03:30.530937 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:03:30.530937 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 21:03:30.530937 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 21:03:30.530937 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 31 21:03:30.530937 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 31 21:03:30.530937 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 21:03:30.530937 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 21:03:30.530937 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 31 21:03:30.530937 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 21:03:30.531858 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot f2d7f49b-5810-4650-aa20-9fcf3c2b35f2 could not be found. May 31 21:03:30.531858 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:03:30.531858 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:03:30.531858 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:03:30.531858 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:03:30.531858 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:03:30.531858 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:03:30.531858 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 21:03:30.531858 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 21:03:30.531858 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot f2d7f49b-5810-4650-aa20-9fcf3c2b35f2 could not be found. May 31 21:03:30.531858 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:03:30.531858 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-50e3723b-b4ab-47c8-980e-7b83fe2f9392 tempest-VolumesSnapshotsTestJSON-385275356 tempest-VolumesSnapshotsTestJSON-385275356-project] Returning 404 to user: Snapshot f2d7f49b-5810-4650-aa20-9fcf3c2b35f2 could not be found. {{(pid=118184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 21:03:30.531858 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-50e3723b-b4ab-47c8-980e-7b83fe2f9392 tempest-VolumesSnapshotsTestJSON-385275356 tempest-VolumesSnapshotsTestJSON-385275356-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/f2d7f49b-5810-4650-aa20-9fcf3c2b35f2" status: 404 len: 111 microversion: 2.1 time: 0.100901 May 31 21:03:30.533055 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 25/42] 10.222.0.55 () {58 vars in 1250 bytes} [Tue May 31 21:03:30 2022] GET /compute/v2.1/os-snapshots/f2d7f49b-5810-4650-aa20-9fcf3c2b35f2 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 31 21:03:30.543600 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-653bff75-1037-4efa-a9dd-7bc711ed9eba tempest-VolumesSnapshotsTestJSON-385275356 tempest-VolumesSnapshotsTestJSON-385275356-project] Calling method '.version_select at 0x7fe7c2a49160>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:30.709464 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-29f4867d-bd44-47d4-8dcc-5aecae85ec0d tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b358c38b5a44d798f7f53c4b318134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f91ac37f864ed98a03f9082252e334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:03:30.723868 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-29f4867d-bd44-47d4-8dcc-5aecae85ec0d tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] 10.222.0.55 "GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8" status: 200 len: 1273 microversion: 2.1 time: 0.428150 May 31 21:03:30.724826 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 18/43] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:03:30 2022] GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8 => generated 1273 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:03:30.929683 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-653bff75-1037-4efa-a9dd-7bc711ed9eba tempest-VolumesSnapshotsTestJSON-385275356 tempest-VolumesSnapshotsTestJSON-385275356-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/c122fa59-d244-4c72-b1c3-78c5f704a7a3" status: 202 len: 0 microversion: 2.1 time: 0.394809 May 31 21:03:30.931576 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 26/44] 10.222.0.55 () {58 vars in 1247 bytes} [Tue May 31 21:03:30 2022] DELETE /compute/v2.1/os-volumes/c122fa59-d244-4c72-b1c3-78c5f704a7a3 => generated 0 bytes in 398 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 21:03:30.947268 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-27a76818-4b95-4758-bddc-80756440cb4f tempest-VolumesSnapshotsTestJSON-385275356 tempest-VolumesSnapshotsTestJSON-385275356-project] Calling method '.version_select at 0x7fe7c19acc10>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:31.079139 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-27a76818-4b95-4758-bddc-80756440cb4f tempest-VolumesSnapshotsTestJSON-385275356 tempest-VolumesSnapshotsTestJSON-385275356-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/c122fa59-d244-4c72-b1c3-78c5f704a7a3" status: 200 len: 344 microversion: 2.1 time: 0.142684 May 31 21:03:31.080633 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 19/45] 10.222.0.55 () {58 vars in 1244 bytes} [Tue May 31 21:03:30 2022] GET /compute/v2.1/os-volumes/c122fa59-d244-4c72-b1c3-78c5f704a7a3 => generated 344 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:03:31.752194 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-b6b88336-13ff-4050-aa9c-9272b7510a69 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:31.753613 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-b6b88336-13ff-4050-aa9c-9272b7510a69 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] [instance: 35c086d9-50bf-494a-90bb-694569f861a8] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:03:31.775519 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b6b88336-13ff-4050-aa9c-9272b7510a69 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:31.782447 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b6b88336-13ff-4050-aa9c-9272b7510a69 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:31.784714 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b6b88336-13ff-4050-aa9c-9272b7510a69 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:31.789611 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b6b88336-13ff-4050-aa9c-9272b7510a69 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:32.089962 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell0:SELECT=2 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:32.094497 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-c1d55d4f-a5a7-45ff-b02f-1f81ed2e528e tempest-VolumesSnapshotsTestJSON-385275356 tempest-VolumesSnapshotsTestJSON-385275356-project] Calling method '.version_select at 0x7fe7c19acca0>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:32.268509 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-c1d55d4f-a5a7-45ff-b02f-1f81ed2e528e tempest-VolumesSnapshotsTestJSON-385275356 tempest-VolumesSnapshotsTestJSON-385275356-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/c122fa59-d244-4c72-b1c3-78c5f704a7a3" status: 200 len: 344 microversion: 2.1 time: 0.179093 May 31 21:03:32.274223 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 20/46] 10.222.0.55 () {58 vars in 1244 bytes} [Tue May 31 21:03:32 2022] GET /compute/v2.1/os-volumes/c122fa59-d244-4c72-b1c3-78c5f704a7a3 => generated 344 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:03:32.768381 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-b6b88336-13ff-4050-aa9c-9272b7510a69 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b358c38b5a44d798f7f53c4b318134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f91ac37f864ed98a03f9082252e334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:03:32.777463 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-b6b88336-13ff-4050-aa9c-9272b7510a69 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] 10.222.0.55 "GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8" status: 200 len: 1273 microversion: 2.1 time: 1.033167 May 31 21:03:32.782185 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 27/47] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:03:31 2022] GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8 => generated 1273 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:03:33.298237 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-8b9d09c7-c741-4874-8bb2-9ad2856cdff5 tempest-VolumesSnapshotsTestJSON-385275356 tempest-VolumesSnapshotsTestJSON-385275356-project] Calling method '.version_select at 0x7fe7c1934a60>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:33.467146 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-8b9d09c7-c741-4874-8bb2-9ad2856cdff5 tempest-VolumesSnapshotsTestJSON-385275356 tempest-VolumesSnapshotsTestJSON-385275356-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/c122fa59-d244-4c72-b1c3-78c5f704a7a3" status: 200 len: 344 microversion: 2.1 time: 0.186737 May 31 21:03:33.468362 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 21/48] 10.222.0.55 () {58 vars in 1244 bytes} [Tue May 31 21:03:33 2022] GET /compute/v2.1/os-volumes/c122fa59-d244-4c72-b1c3-78c5f704a7a3 => generated 344 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:03:33.803129 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-ba2a42e2-1030-4351-a8d8-aba41c516fae tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:33.804202 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-ba2a42e2-1030-4351-a8d8-aba41c516fae tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] [instance: 35c086d9-50bf-494a-90bb-694569f861a8] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:03:33.812647 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell0:SELECT=10 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:33.829190 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ba2a42e2-1030-4351-a8d8-aba41c516fae tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:33.832619 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ba2a42e2-1030-4351-a8d8-aba41c516fae tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:33.833679 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ba2a42e2-1030-4351-a8d8-aba41c516fae tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:33.836898 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ba2a42e2-1030-4351-a8d8-aba41c516fae tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:34.087307 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-1b88a091-6e57-496f-bda5-270a38a4d1bc tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Action: 'create', calling method: .version_select at 0x7fe7c2a491f0>, body: {"keypair": {"name": "tempest-keypair-869555078", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOcm+iBFKbH60vlYpKDaiAvxS3Dwcespwm6ORtwPwSIMJPg7ajCLaEm5JKyY3h2tPFsbLTiIJFhjlH1V3O4vh/YHbGvCODwoMzRIxqrpA65+/52/En7gBNnZkrw2/qIIVQ=="}} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:03:34.236910 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.quota [None req-1b88a091-6e57-496f-bda5-270a38a4d1bc tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Getting quotas for project 180ff6fd8c5b434abffa058ea99ef7c4. Resources: {'key_pairs'} {{(pid=118184) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 21:03:34.253635 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.quota [None req-1b88a091-6e57-496f-bda5-270a38a4d1bc tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Getting quotas for user 92d56ad8d4ab4c1099263a3d1c43490a and project 180ff6fd8c5b434abffa058ea99ef7c4. Resources: {'key_pairs'} {{(pid=118184) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 21:03:34.466349 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-1b88a091-6e57-496f-bda5-270a38a4d1bc tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.805720 May 31 21:03:34.478831 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 28/49] 10.222.0.55 () {60 vars in 1158 bytes} [Tue May 31 21:03:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:03:34.514033 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-b9f6130f-8d69-4f48-bef0-3420023eaaac tempest-VolumesSnapshotsTestJSON-385275356 tempest-VolumesSnapshotsTestJSON-385275356-project] Calling method '.version_select at 0x7fe7c2991280>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:34.660779 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-b9f6130f-8d69-4f48-bef0-3420023eaaac tempest-VolumesSnapshotsTestJSON-385275356 tempest-VolumesSnapshotsTestJSON-385275356-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/c122fa59-d244-4c72-b1c3-78c5f704a7a3" status: 200 len: 344 microversion: 2.1 time: 0.180639 May 31 21:03:34.661336 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 29/50] 10.222.0.55 () {58 vars in 1244 bytes} [Tue May 31 21:03:34 2022] GET /compute/v2.1/os-volumes/c122fa59-d244-4c72-b1c3-78c5f704a7a3 => generated 344 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:03:34.756041 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-ba2a42e2-1030-4351-a8d8-aba41c516fae tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b358c38b5a44d798f7f53c4b318134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f91ac37f864ed98a03f9082252e334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:03:34.778014 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-ba2a42e2-1030-4351-a8d8-aba41c516fae tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] 10.222.0.55 "GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8" status: 200 len: 1315 microversion: 2.1 time: 0.976163 May 31 21:03:34.788386 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 22/51] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:03:33 2022] GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8 => generated 1315 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:03:35.695918 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-672825e3-6c2c-4949-81ed-2da3470b2e70 tempest-VolumesSnapshotsTestJSON-385275356 tempest-VolumesSnapshotsTestJSON-385275356-project] Calling method '.version_select at 0x7fe7c19aca60>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:35.819142 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-672825e3-6c2c-4949-81ed-2da3470b2e70 tempest-VolumesSnapshotsTestJSON-385275356 tempest-VolumesSnapshotsTestJSON-385275356-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/c122fa59-d244-4c72-b1c3-78c5f704a7a3" status: 200 len: 344 microversion: 2.1 time: 0.147218 May 31 21:03:35.829167 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 23/52] 10.222.0.55 () {58 vars in 1244 bytes} [Tue May 31 21:03:35 2022] GET /compute/v2.1/os-volumes/c122fa59-d244-4c72-b1c3-78c5f704a7a3 => generated 344 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:03:35.829167 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-448e1640-5ce5-48da-a054-20185565bbe0 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:35.829167 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-448e1640-5ce5-48da-a054-20185565bbe0 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] [instance: 35c086d9-50bf-494a-90bb-694569f861a8] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:03:35.833073 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-448e1640-5ce5-48da-a054-20185565bbe0 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:35.833755 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-448e1640-5ce5-48da-a054-20185565bbe0 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:35.835224 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-448e1640-5ce5-48da-a054-20185565bbe0 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:35.836112 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-448e1640-5ce5-48da-a054-20185565bbe0 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:36.149952 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-448e1640-5ce5-48da-a054-20185565bbe0 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b358c38b5a44d798f7f53c4b318134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f91ac37f864ed98a03f9082252e334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:03:36.171506 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-448e1640-5ce5-48da-a054-20185565bbe0 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] 10.222.0.55 "GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8" status: 200 len: 1315 microversion: 2.1 time: 0.350693 May 31 21:03:36.173823 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 24/53] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:03:35 2022] GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8 => generated 1315 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:03:36.918289 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-fb250373-69b3-41f4-b51a-66a2838cd765 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1067991369", "imageRef": "21b89996-9e87-489d-8891-305f6c3d905a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:03:37.151851 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.network.neutron [None req-fb250373-69b3-41f4-b51a-66a2838cd765 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] validate_networks() for [('50707fc3-657a-4d1c-8628-0dfb2710b9bc', None, None, None, None, None)] {{(pid=118184) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 21:03:37.311721 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-b23ddd14-e368-477b-8ba0-b5eec9c53ce4 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Action: 'create', calling method: .version_select at 0x7fe7c19acc10>, body: {"keypair": {"name": "tempest-keypair-836839230", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZEnVlRPgYVKT9tpAi7kUTCuamQSSN+fBJucj5Haa+JS68MPyiDmAh6a3V9wGPxcYXFb3+xzWc1o+HjDzVpYgyOcvdXuSN6eKFUpsqsP3tgWWCGMsAfzPsAXJ+VoGWVxw=="}} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:03:37.380411 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.quota [None req-b23ddd14-e368-477b-8ba0-b5eec9c53ce4 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Getting quotas for project af420d43367c42e4a4b0948706dd0546. Resources: {'key_pairs'} {{(pid=118185) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 21:03:37.404726 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.quota [None req-b23ddd14-e368-477b-8ba0-b5eec9c53ce4 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Getting quotas for user 2d69edafe80649d4aff602b692e294c8 and project af420d43367c42e4a4b0948706dd0546. Resources: {'key_pairs'} {{(pid=118185) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 21:03:37.598932 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-b23ddd14-e368-477b-8ba0-b5eec9c53ce4 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.395327 May 31 21:03:37.600681 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 25/54] 10.222.0.55 () {62 vars in 1199 bytes} [Tue May 31 21:03:36 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1398 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 31 21:03:37.605885 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-9ba638ed-b032-46b4-9f79-8e3acb1fe7a6 tempest-VolumesSnapshotsTestJSON-385275356 tempest-VolumesSnapshotsTestJSON-385275356-project] Calling method '.version_select at 0x7fe7c1934310>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:37.708018 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.wsgi [None req-9ba638ed-b032-46b4-9f79-8e3acb1fe7a6 tempest-VolumesSnapshotsTestJSON-385275356 tempest-VolumesSnapshotsTestJSON-385275356-project] HTTP exception thrown: Volume c122fa59-d244-4c72-b1c3-78c5f704a7a3 could not be found. May 31 21:03:37.720197 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-9ba638ed-b032-46b4-9f79-8e3acb1fe7a6 tempest-VolumesSnapshotsTestJSON-385275356 tempest-VolumesSnapshotsTestJSON-385275356-project] Request method failure captured: May 31 21:03:37.720197 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: request: GET /compute/v2.1/os-volumes/c122fa59-d244-4c72-b1c3-78c5f704a7a3 HTTP/1.1 May 31 21:03:37.720197 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Accept: application/json May 31 21:03:37.720197 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Accept-Encoding: identity May 31 21:03:37.720197 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Connection: close May 31 21:03:37.720197 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Content-Length: 0 May 31 21:03:37.720197 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Content-Type: application/json May 31 21:03:37.720197 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Host: 10.222.0.55 May 31 21:03:37.720197 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Openstack-System-Scope: None May 31 21:03:37.720197 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: User-Agent: python-urllib3/1.26.9 May 31 21:03:37.720197 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Auth-Token: gAAAAABiloKTlXRmEA3yjjhzHliYBVJ1lpHIqaY6iAx2CjBprs6UpMe3Oh6i1l02RPwcHUAta2kchDNqqb4fJEls_iQgZMmOP3ZCmTBBVQyoIXstbJ6pew1htyPAhgYTKcDIRojms4ar3GXkIYX7hRIcT7spbHVsmy9Bunn5XAeYPzm4RcsorhI May 31 21:03:37.720197 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Domain-Id: None May 31 21:03:37.720197 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Domain-Name: None May 31 21:03:37.720197 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Identity-Status: Confirmed May 31 21:03:37.720197 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Is-Admin-Project: True May 31 21:03:37.720197 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Domain-Id: default May 31 21:03:37.720197 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Domain-Name: Default May 31 21:03:37.720197 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Id: 979727d273dc44faa7861e084aea2022 May 31 21:03:37.720197 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-385275356 May 31 21:03:37.720197 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Role: member,reader May 31 21:03:37.720197 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Roles: member,reader May 31 21:03:37.721341 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/979727d273dc44faa7861e084aea2022"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/979727d273dc44faa7861e084aea2022"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_979727d273dc44faa7861e084aea2022", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/979727d273dc44faa7861e084aea2022"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] May 31 21:03:37.721341 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant: tempest-VolumesSnapshotsTestJSON-385275356 May 31 21:03:37.721341 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant-Id: 979727d273dc44faa7861e084aea2022 May 31 21:03:37.721341 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-385275356 May 31 21:03:37.721341 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User: tempest-VolumesSnapshotsTestJSON-385275356-project May 31 21:03:37.721341 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Domain-Id: default May 31 21:03:37.721341 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Domain-Name: Default May 31 21:03:37.721341 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Id: f1b9a99fb432495aa5f4d0402a7858ff May 31 21:03:37.721341 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Name: tempest-VolumesSnapshotsTestJSON-385275356-project May 31 21:03:37.721341 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: method: May 31 21:03:37.721341 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: exception: Volume c122fa59-d244-4c72-b1c3-78c5f704a7a3 could not be found. May 31 21:03:37.721341 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: action_args: {'id': 'c122fa59-d244-4c72-b1c3-78c5f704a7a3'} May 31 21:03:37.721341 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 21:03:37.722078 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:03:37.722078 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 31 21:03:37.722078 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 31 21:03:37.722078 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 31 21:03:37.722078 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi item = cinderclient( May 31 21:03:37.722078 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 31 21:03:37.722078 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 31 21:03:37.722078 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 31 21:03:37.722078 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 31 21:03:37.722078 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 31 21:03:37.722078 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 31 21:03:37.722078 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 31 21:03:37.722078 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 31 21:03:37.722078 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 31 21:03:37.722078 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 31 21:03:37.722078 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c122fa59-d244-4c72-b1c3-78c5f704a7a3 could not be found. (HTTP 404) (Request-ID: req-2180fdfb-5bed-40a3-8e7e-3c64d11537da) May 31 21:03:37.722078 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:03:37.722078 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:03:37.722078 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:03:37.723091 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:03:37.723091 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 31 21:03:37.723091 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 31 21:03:37.723091 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 31 21:03:37.723091 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 31 21:03:37.723091 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 31 21:03:37.723091 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 31 21:03:37.723091 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 31 21:03:37.723091 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 31 21:03:37.723091 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 31 21:03:37.723091 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 31 21:03:37.723091 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 31 21:03:37.723091 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi item = cinderclient( May 31 21:03:37.723091 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 31 21:03:37.723091 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 31 21:03:37.723091 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 31 21:03:37.723091 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 31 21:03:37.723091 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 31 21:03:37.723091 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 31 21:03:37.724150 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 31 21:03:37.724150 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 31 21:03:37.724150 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 31 21:03:37.724150 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 31 21:03:37.724150 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c122fa59-d244-4c72-b1c3-78c5f704a7a3 could not be found. May 31 21:03:37.724150 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:03:37.724150 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:03:37.724150 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:03:37.724150 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:03:37.724150 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:03:37.724150 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:03:37.724150 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 21:03:37.724150 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 21:03:37.724150 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 31 21:03:37.724150 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 31 21:03:37.724150 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 21:03:37.724150 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 21:03:37.724150 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 31 21:03:37.724150 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 21:03:37.727651 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c122fa59-d244-4c72-b1c3-78c5f704a7a3 could not be found. May 31 21:03:37.727651 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:03:37.727651 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:03:37.727651 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:03:37.727651 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:03:37.727651 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:03:37.727651 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:03:37.727651 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 21:03:37.727651 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 21:03:37.727651 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c122fa59-d244-4c72-b1c3-78c5f704a7a3 could not be found. May 31 21:03:37.727651 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:03:37.727651 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-9ba638ed-b032-46b4-9f79-8e3acb1fe7a6 tempest-VolumesSnapshotsTestJSON-385275356 tempest-VolumesSnapshotsTestJSON-385275356-project] Returning 404 to user: Volume c122fa59-d244-4c72-b1c3-78c5f704a7a3 could not be found. {{(pid=118185) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 21:03:37.733294 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-9ba638ed-b032-46b4-9f79-8e3acb1fe7a6 tempest-VolumesSnapshotsTestJSON-385275356 tempest-VolumesSnapshotsTestJSON-385275356-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/c122fa59-d244-4c72-b1c3-78c5f704a7a3" status: 404 len: 109 microversion: 2.1 time: 0.131028 May 31 21:03:37.736718 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 26/55] 10.222.0.55 () {58 vars in 1244 bytes} [Tue May 31 21:03:37 2022] GET /compute/v2.1/os-volumes/c122fa59-d244-4c72-b1c3-78c5f704a7a3 => generated 109 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 21:03:37.752539 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-4d5e682a-e5f8-47df-89c8-de9d503b2f81 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:37.770138 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-4d5e682a-e5f8-47df-89c8-de9d503b2f81 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] [instance: 35c086d9-50bf-494a-90bb-694569f861a8] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:03:37.797516 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4d5e682a-e5f8-47df-89c8-de9d503b2f81 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:37.798015 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4d5e682a-e5f8-47df-89c8-de9d503b2f81 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:37.798817 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4d5e682a-e5f8-47df-89c8-de9d503b2f81 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:37.799261 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4d5e682a-e5f8-47df-89c8-de9d503b2f81 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:38.856849 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-4d5e682a-e5f8-47df-89c8-de9d503b2f81 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b358c38b5a44d798f7f53c4b318134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f91ac37f864ed98a03f9082252e334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:03:38.866992 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-4d5e682a-e5f8-47df-89c8-de9d503b2f81 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] 10.222.0.55 "GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8" status: 200 len: 1315 microversion: 2.1 time: 1.126455 May 31 21:03:38.892474 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 27/56] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:03:37 2022] GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8 => generated 1315 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:03:38.906552 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-ec180a43-82f2-46e4-bd78-29bad9f2b9d4 tempest-VolumesSnapshotsTestJSON-385275356 tempest-VolumesSnapshotsTestJSON-385275356-project] Calling method '.version_select at 0x7fe7c19489d0>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:39.013425 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.wsgi [None req-ec180a43-82f2-46e4-bd78-29bad9f2b9d4 tempest-VolumesSnapshotsTestJSON-385275356 tempest-VolumesSnapshotsTestJSON-385275356-project] HTTP exception thrown: Volume c122fa59-d244-4c72-b1c3-78c5f704a7a3 could not be found. May 31 21:03:39.016210 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-ec180a43-82f2-46e4-bd78-29bad9f2b9d4 tempest-VolumesSnapshotsTestJSON-385275356 tempest-VolumesSnapshotsTestJSON-385275356-project] Request method failure captured: May 31 21:03:39.016210 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: request: DELETE /compute/v2.1/os-volumes/c122fa59-d244-4c72-b1c3-78c5f704a7a3 HTTP/1.1 May 31 21:03:39.016210 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Accept: application/json May 31 21:03:39.016210 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Accept-Encoding: identity May 31 21:03:39.016210 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Connection: close May 31 21:03:39.016210 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Content-Length: 0 May 31 21:03:39.016210 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Content-Type: application/json May 31 21:03:39.016210 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Host: 10.222.0.55 May 31 21:03:39.016210 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Openstack-System-Scope: None May 31 21:03:39.016210 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: User-Agent: python-urllib3/1.26.9 May 31 21:03:39.016210 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Auth-Token: gAAAAABiloKTlXRmEA3yjjhzHliYBVJ1lpHIqaY6iAx2CjBprs6UpMe3Oh6i1l02RPwcHUAta2kchDNqqb4fJEls_iQgZMmOP3ZCmTBBVQyoIXstbJ6pew1htyPAhgYTKcDIRojms4ar3GXkIYX7hRIcT7spbHVsmy9Bunn5XAeYPzm4RcsorhI May 31 21:03:39.016210 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Domain-Id: None May 31 21:03:39.016210 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Domain-Name: None May 31 21:03:39.016210 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Identity-Status: Confirmed May 31 21:03:39.016210 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Is-Admin-Project: True May 31 21:03:39.016210 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Domain-Id: default May 31 21:03:39.016210 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Domain-Name: Default May 31 21:03:39.016210 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Id: 979727d273dc44faa7861e084aea2022 May 31 21:03:39.016210 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-385275356 May 31 21:03:39.016210 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Role: member,reader May 31 21:03:39.016210 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Roles: member,reader May 31 21:03:39.017433 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/979727d273dc44faa7861e084aea2022"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/979727d273dc44faa7861e084aea2022"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_979727d273dc44faa7861e084aea2022", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/979727d273dc44faa7861e084aea2022"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] May 31 21:03:39.017433 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant: tempest-VolumesSnapshotsTestJSON-385275356 May 31 21:03:39.017433 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant-Id: 979727d273dc44faa7861e084aea2022 May 31 21:03:39.017433 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-385275356 May 31 21:03:39.017433 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User: tempest-VolumesSnapshotsTestJSON-385275356-project May 31 21:03:39.017433 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Domain-Id: default May 31 21:03:39.017433 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Domain-Name: Default May 31 21:03:39.017433 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Id: f1b9a99fb432495aa5f4d0402a7858ff May 31 21:03:39.017433 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Name: tempest-VolumesSnapshotsTestJSON-385275356-project May 31 21:03:39.017433 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: method: May 31 21:03:39.017433 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: exception: Volume c122fa59-d244-4c72-b1c3-78c5f704a7a3 could not be found. May 31 21:03:39.017433 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: action_args: {'id': 'c122fa59-d244-4c72-b1c3-78c5f704a7a3'} May 31 21:03:39.017433 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 21:03:39.018315 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:03:39.018315 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 31 21:03:39.018315 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 31 21:03:39.018315 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 31 21:03:39.018315 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 31 21:03:39.018315 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 31 21:03:39.018315 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 31 21:03:39.018315 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 31 21:03:39.018315 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 31 21:03:39.018315 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 31 21:03:39.018315 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 31 21:03:39.018315 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 31 21:03:39.018315 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 31 21:03:39.018315 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 31 21:03:39.018315 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 31 21:03:39.018315 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c122fa59-d244-4c72-b1c3-78c5f704a7a3 could not be found. (HTTP 404) (Request-ID: req-d1264228-051f-47ff-9ad3-c009e542b82a) May 31 21:03:39.018315 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:03:39.018315 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:03:39.018315 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:03:39.019814 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:03:39.019814 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 31 21:03:39.019814 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 31 21:03:39.019814 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 31 21:03:39.019814 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 31 21:03:39.019814 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 31 21:03:39.019814 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 31 21:03:39.019814 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 31 21:03:39.019814 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 31 21:03:39.019814 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 31 21:03:39.019814 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 31 21:03:39.019814 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 31 21:03:39.019814 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 31 21:03:39.019814 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 31 21:03:39.019814 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 31 21:03:39.019814 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 31 21:03:39.019814 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 31 21:03:39.019814 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 31 21:03:39.019814 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 31 21:03:39.020705 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 31 21:03:39.020705 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 31 21:03:39.020705 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 31 21:03:39.020705 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 31 21:03:39.020705 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c122fa59-d244-4c72-b1c3-78c5f704a7a3 could not be found. May 31 21:03:39.020705 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:03:39.020705 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:03:39.020705 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:03:39.020705 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:03:39.020705 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:03:39.020705 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:03:39.020705 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 21:03:39.020705 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 21:03:39.020705 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 31 21:03:39.020705 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 31 21:03:39.020705 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 21:03:39.020705 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 21:03:39.020705 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 31 21:03:39.020705 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 21:03:39.021681 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c122fa59-d244-4c72-b1c3-78c5f704a7a3 could not be found. May 31 21:03:39.021681 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:03:39.021681 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:03:39.021681 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:03:39.021681 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:03:39.021681 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:03:39.021681 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:03:39.021681 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 21:03:39.021681 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 21:03:39.021681 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c122fa59-d244-4c72-b1c3-78c5f704a7a3 could not be found. May 31 21:03:39.021681 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:03:39.023413 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-ec180a43-82f2-46e4-bd78-29bad9f2b9d4 tempest-VolumesSnapshotsTestJSON-385275356 tempest-VolumesSnapshotsTestJSON-385275356-project] Returning 404 to user: Volume c122fa59-d244-4c72-b1c3-78c5f704a7a3 could not be found. {{(pid=118185) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 21:03:39.025038 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-ec180a43-82f2-46e4-bd78-29bad9f2b9d4 tempest-VolumesSnapshotsTestJSON-385275356 tempest-VolumesSnapshotsTestJSON-385275356-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/c122fa59-d244-4c72-b1c3-78c5f704a7a3" status: 404 len: 109 microversion: 2.1 time: 0.131243 May 31 21:03:39.025794 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 28/57] 10.222.0.55 () {58 vars in 1247 bytes} [Tue May 31 21:03:38 2022] DELETE /compute/v2.1/os-volumes/c122fa59-d244-4c72-b1c3-78c5f704a7a3 => generated 109 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 21:03:39.041861 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-ca458443-0ed9-4bcc-9d43-d80ff394b5f3 tempest-VolumesSnapshotsTestJSON-385275356 tempest-VolumesSnapshotsTestJSON-385275356-project] Calling method '.version_select at 0x7fe7c18cc5e0>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:39.181090 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.wsgi [None req-ca458443-0ed9-4bcc-9d43-d80ff394b5f3 tempest-VolumesSnapshotsTestJSON-385275356 tempest-VolumesSnapshotsTestJSON-385275356-project] HTTP exception thrown: Volume c122fa59-d244-4c72-b1c3-78c5f704a7a3 could not be found. May 31 21:03:39.184496 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-ca458443-0ed9-4bcc-9d43-d80ff394b5f3 tempest-VolumesSnapshotsTestJSON-385275356 tempest-VolumesSnapshotsTestJSON-385275356-project] Request method failure captured: May 31 21:03:39.184496 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: request: GET /compute/v2.1/os-volumes/c122fa59-d244-4c72-b1c3-78c5f704a7a3 HTTP/1.1 May 31 21:03:39.184496 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Accept: application/json May 31 21:03:39.184496 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Accept-Encoding: identity May 31 21:03:39.184496 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Connection: close May 31 21:03:39.184496 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Content-Length: 0 May 31 21:03:39.184496 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Content-Type: application/json May 31 21:03:39.184496 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Host: 10.222.0.55 May 31 21:03:39.184496 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Openstack-System-Scope: None May 31 21:03:39.184496 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: User-Agent: python-urllib3/1.26.9 May 31 21:03:39.184496 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Auth-Token: gAAAAABiloKTlXRmEA3yjjhzHliYBVJ1lpHIqaY6iAx2CjBprs6UpMe3Oh6i1l02RPwcHUAta2kchDNqqb4fJEls_iQgZMmOP3ZCmTBBVQyoIXstbJ6pew1htyPAhgYTKcDIRojms4ar3GXkIYX7hRIcT7spbHVsmy9Bunn5XAeYPzm4RcsorhI May 31 21:03:39.184496 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Domain-Id: None May 31 21:03:39.184496 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Domain-Name: None May 31 21:03:39.184496 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Identity-Status: Confirmed May 31 21:03:39.184496 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Is-Admin-Project: True May 31 21:03:39.184496 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Domain-Id: default May 31 21:03:39.184496 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Domain-Name: Default May 31 21:03:39.184496 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Id: 979727d273dc44faa7861e084aea2022 May 31 21:03:39.184496 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-385275356 May 31 21:03:39.184496 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Role: member,reader May 31 21:03:39.184496 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Roles: member,reader May 31 21:03:39.185592 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/979727d273dc44faa7861e084aea2022"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/979727d273dc44faa7861e084aea2022"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_979727d273dc44faa7861e084aea2022", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/979727d273dc44faa7861e084aea2022"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] May 31 21:03:39.185592 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant: tempest-VolumesSnapshotsTestJSON-385275356 May 31 21:03:39.185592 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant-Id: 979727d273dc44faa7861e084aea2022 May 31 21:03:39.185592 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-385275356 May 31 21:03:39.185592 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User: tempest-VolumesSnapshotsTestJSON-385275356-project May 31 21:03:39.185592 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Domain-Id: default May 31 21:03:39.185592 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Domain-Name: Default May 31 21:03:39.185592 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Id: f1b9a99fb432495aa5f4d0402a7858ff May 31 21:03:39.185592 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Name: tempest-VolumesSnapshotsTestJSON-385275356-project May 31 21:03:39.185592 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: method: May 31 21:03:39.185592 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: exception: Volume c122fa59-d244-4c72-b1c3-78c5f704a7a3 could not be found. May 31 21:03:39.185592 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: action_args: {'id': 'c122fa59-d244-4c72-b1c3-78c5f704a7a3'} May 31 21:03:39.185592 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 21:03:39.186333 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:03:39.186333 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 31 21:03:39.186333 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 31 21:03:39.186333 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 31 21:03:39.186333 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi item = cinderclient( May 31 21:03:39.186333 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 31 21:03:39.186333 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 31 21:03:39.186333 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 31 21:03:39.186333 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 31 21:03:39.186333 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 31 21:03:39.186333 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 31 21:03:39.186333 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 31 21:03:39.186333 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 31 21:03:39.186333 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 31 21:03:39.186333 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 31 21:03:39.186333 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c122fa59-d244-4c72-b1c3-78c5f704a7a3 could not be found. (HTTP 404) (Request-ID: req-d898f972-f912-4cf0-a9bf-f024d4ea3657) May 31 21:03:39.186333 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:03:39.186333 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:03:39.186333 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:03:39.187638 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:03:39.187638 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 31 21:03:39.187638 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 31 21:03:39.187638 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 31 21:03:39.187638 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 31 21:03:39.187638 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 31 21:03:39.187638 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 31 21:03:39.187638 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 31 21:03:39.187638 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 31 21:03:39.187638 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 31 21:03:39.187638 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 31 21:03:39.187638 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 31 21:03:39.187638 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi item = cinderclient( May 31 21:03:39.187638 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 31 21:03:39.187638 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 31 21:03:39.187638 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 31 21:03:39.187638 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 31 21:03:39.187638 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 31 21:03:39.187638 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 31 21:03:39.188624 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 31 21:03:39.188624 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 31 21:03:39.188624 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 31 21:03:39.188624 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 31 21:03:39.188624 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c122fa59-d244-4c72-b1c3-78c5f704a7a3 could not be found. May 31 21:03:39.188624 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:03:39.188624 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:03:39.188624 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:03:39.188624 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:03:39.188624 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:03:39.188624 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:03:39.188624 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 21:03:39.188624 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 21:03:39.188624 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 31 21:03:39.188624 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 31 21:03:39.188624 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 21:03:39.188624 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 21:03:39.188624 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 31 21:03:39.188624 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 21:03:39.189520 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c122fa59-d244-4c72-b1c3-78c5f704a7a3 could not be found. May 31 21:03:39.189520 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:03:39.189520 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:03:39.189520 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:03:39.189520 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:03:39.189520 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:03:39.189520 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:03:39.189520 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 21:03:39.189520 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 21:03:39.189520 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c122fa59-d244-4c72-b1c3-78c5f704a7a3 could not be found. May 31 21:03:39.189520 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:03:39.189520 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-ca458443-0ed9-4bcc-9d43-d80ff394b5f3 tempest-VolumesSnapshotsTestJSON-385275356 tempest-VolumesSnapshotsTestJSON-385275356-project] Returning 404 to user: Volume c122fa59-d244-4c72-b1c3-78c5f704a7a3 could not be found. {{(pid=118185) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 21:03:39.189520 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-ca458443-0ed9-4bcc-9d43-d80ff394b5f3 tempest-VolumesSnapshotsTestJSON-385275356 tempest-VolumesSnapshotsTestJSON-385275356-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/c122fa59-d244-4c72-b1c3-78c5f704a7a3" status: 404 len: 109 microversion: 2.1 time: 0.154099 May 31 21:03:39.190251 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 29/58] 10.222.0.55 () {58 vars in 1244 bytes} [Tue May 31 21:03:39 2022] GET /compute/v2.1/os-volumes/c122fa59-d244-4c72-b1c3-78c5f704a7a3 => generated 109 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 21:03:39.887545 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-077299c2-cdad-4eb1-8c5f-de480d53f7d6 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:39.888954 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-077299c2-cdad-4eb1-8c5f-de480d53f7d6 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] [instance: 35c086d9-50bf-494a-90bb-694569f861a8] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:03:39.901638 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-077299c2-cdad-4eb1-8c5f-de480d53f7d6 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:39.902536 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-077299c2-cdad-4eb1-8c5f-de480d53f7d6 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:39.906723 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-077299c2-cdad-4eb1-8c5f-de480d53f7d6 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:39.907428 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-077299c2-cdad-4eb1-8c5f-de480d53f7d6 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:41.258599 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-077299c2-cdad-4eb1-8c5f-de480d53f7d6 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b358c38b5a44d798f7f53c4b318134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f91ac37f864ed98a03f9082252e334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:03:41.270345 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-077299c2-cdad-4eb1-8c5f-de480d53f7d6 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] 10.222.0.55 "GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8" status: 200 len: 1315 microversion: 2.1 time: 1.386666 May 31 21:03:41.271761 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 30/59] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:03:39 2022] GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8 => generated 1315 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:03:42.007753 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [req-14b1860d-bd55-432c-9cfc-a28f6916e3e9 req-0160d373-7ab6-462b-b885-b9771cc0c99e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35c086d9-50bf-494a-90bb-694569f861a8", "tag": "837c9641-8167-4561-b45f-1b48acf21abc"}]} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:03:42.053141 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-14b1860d-bd55-432c-9cfc-a28f6916e3e9 req-0160d373-7ab6-462b-b885-b9771cc0c99e service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:42.053595 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-14b1860d-bd55-432c-9cfc-a28f6916e3e9 req-0160d373-7ab6-462b-b885-b9771cc0c99e service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:42.195958 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.compute.server_external_events [req-14b1860d-bd55-432c-9cfc-a28f6916e3e9 req-0160d373-7ab6-462b-b885-b9771cc0c99e service nova] Creating event network-changed:837c9641-8167-4561-b45f-1b48acf21abc for instance 35c086d9-50bf-494a-90bb-694569f861a8 on hv-cinder-83979 May 31 21:03:42.196536 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-14b1860d-bd55-432c-9cfc-a28f6916e3e9 req-0160d373-7ab6-462b-b885-b9771cc0c99e service nova] Acquired lock "compute-rpcapi-router" {{(pid=118185) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 31 21:03:42.201528 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c40bcf00-f114-4d4d-9a77-37e21b02df79 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:42.203350 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c40bcf00-f114-4d4d-9a77-37e21b02df79 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:42.204247 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c40bcf00-f114-4d4d-9a77-37e21b02df79 None None] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:42.206930 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c40bcf00-f114-4d4d-9a77-37e21b02df79 None None] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:42.240714 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.compute.rpcapi [None req-c40bcf00-f114-4d4d-9a77-37e21b02df79 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 31 21:03:42.242158 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c40bcf00-f114-4d4d-9a77-37e21b02df79 None None] Releasing lock "compute-rpcapi-router" {{(pid=118185) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 31 21:03:42.319536 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-c40bcf00-f114-4d4d-9a77-37e21b02df79 None None] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.655569 May 31 21:03:42.319536 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 31/60] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:03:42.323852 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-04389534-5f8f-4108-9500-00509adf9dc4 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:42.332100 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-04389534-5f8f-4108-9500-00509adf9dc4 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] [instance: 35c086d9-50bf-494a-90bb-694569f861a8] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:03:42.406219 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-04389534-5f8f-4108-9500-00509adf9dc4 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:42.408066 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-04389534-5f8f-4108-9500-00509adf9dc4 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:42.416979 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-04389534-5f8f-4108-9500-00509adf9dc4 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:42.418828 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-04389534-5f8f-4108-9500-00509adf9dc4 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:42.776846 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell1:SELECT=18 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:43.218501 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.virt.hardware [None req-fb250373-69b3-41f4-b51a-66a2838cd765 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Flavor limits 0:0:0 {{(pid=118184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 21:03:43.219126 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.virt.hardware [None req-fb250373-69b3-41f4-b51a-66a2838cd765 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Image limits 0:0:0 {{(pid=118184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 21:03:43.219756 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.virt.hardware [None req-fb250373-69b3-41f4-b51a-66a2838cd765 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Flavor pref 0:0:0 {{(pid=118184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 21:03:43.221325 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.virt.hardware [None req-fb250373-69b3-41f4-b51a-66a2838cd765 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Image pref 0:0:0 {{(pid=118184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 21:03:43.222118 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.virt.hardware [None req-fb250373-69b3-41f4-b51a-66a2838cd765 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 21:03:43.233217 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-04389534-5f8f-4108-9500-00509adf9dc4 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b358c38b5a44d798f7f53c4b318134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f91ac37f864ed98a03f9082252e334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:03:43.245061 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-04389534-5f8f-4108-9500-00509adf9dc4 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] 10.222.0.55 "GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8" status: 200 len: 1315 microversion: 2.1 time: 0.931215 May 31 21:03:43.280308 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 32/61] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:03:42 2022] GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8 => generated 1315 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:03:43.281823 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-fb250373-69b3-41f4-b51a-66a2838cd765 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:43.282564 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-fb250373-69b3-41f4-b51a-66a2838cd765 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:43.283724 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-fb250373-69b3-41f4-b51a-66a2838cd765 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:43.284463 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-fb250373-69b3-41f4-b51a-66a2838cd765 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:43.308266 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-f0f7f4c5-5587-47b3-b651-7885df5e4773 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1071765352", "imageRef": "21b89996-9e87-489d-8891-305f6c3d905a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1cab6d20-22a6-4088-8e1d-60992c365df4"}], "security_groups": [{"name": "tempest-securitygroup--1806550771"}], "key_name": "tempest-keypair-869555078", "user_data": "}} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:03:43.320114 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.quota [None req-fb250373-69b3-41f4-b51a-66a2838cd765 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Getting quotas for project f1b54ceb69fc4041b743a11eda4144a8. Resources: {'ram', 'cores', 'instances'} {{(pid=118184) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 21:03:43.327258 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.quota [None req-fb250373-69b3-41f4-b51a-66a2838cd765 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Getting quotas for user bbf377756836405d804d2aaba6e44c1f and project f1b54ceb69fc4041b743a11eda4144a8. Resources: {'ram', 'cores', 'instances'} {{(pid=118184) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 21:03:43.384825 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-fb250373-69b3-41f4-b51a-66a2838cd765 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Going to run 1 instances... {{(pid=118184) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 21:03:43.399057 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-fb250373-69b3-41f4-b51a-66a2838cd765 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 24059932-87a0-4e56-8bb0-4797276e2042] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='21b89996-9e87-489d-8891-305f6c3d905a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118184) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 21:03:43.671233 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-fb250373-69b3-41f4-b51a-66a2838cd765 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 8.053670 May 31 21:03:43.672172 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 30/62] 10.222.0.55 () {60 vars in 1146 bytes} [Tue May 31 21:03:35 2022] POST /compute/v2.1/servers => generated 383 bytes in 8056 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 31 21:03:43.685578 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-440f3584-f1d6-443b-9348-314e89f590f2 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:43.688458 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-440f3584-f1d6-443b-9348-314e89f590f2 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 24059932-87a0-4e56-8bb0-4797276e2042] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:03:44.028104 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-440f3584-f1d6-443b-9348-314e89f590f2 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:03:44.035996 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-440f3584-f1d6-443b-9348-314e89f590f2 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/24059932-87a0-4e56-8bb0-4797276e2042" status: 200 len: 1222 microversion: 2.1 time: 0.355880 May 31 21:03:44.036586 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 31/63] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:03:43 2022] GET /compute/v2.1/servers/24059932-87a0-4e56-8bb0-4797276e2042 => generated 1222 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:03:44.291943 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-5d009e2f-a14f-4d15-9d69-3ef1eb370aaf tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:44.292738 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-5d009e2f-a14f-4d15-9d69-3ef1eb370aaf tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] [instance: 35c086d9-50bf-494a-90bb-694569f861a8] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:03:44.312906 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.network.neutron [None req-f0f7f4c5-5587-47b3-b651-7885df5e4773 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] validate_networks() for [('1cab6d20-22a6-4088-8e1d-60992c365df4', None, None, None, None, None)] {{(pid=118185) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 21:03:44.316369 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5d009e2f-a14f-4d15-9d69-3ef1eb370aaf tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:44.323834 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5d009e2f-a14f-4d15-9d69-3ef1eb370aaf tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:44.326573 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5d009e2f-a14f-4d15-9d69-3ef1eb370aaf tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:44.330406 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5d009e2f-a14f-4d15-9d69-3ef1eb370aaf tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:45.495255 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-5d009e2f-a14f-4d15-9d69-3ef1eb370aaf tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b358c38b5a44d798f7f53c4b318134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f91ac37f864ed98a03f9082252e334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:03:45.556634 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-5d009e2f-a14f-4d15-9d69-3ef1eb370aaf tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] 10.222.0.55 "GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8" status: 200 len: 1315 microversion: 2.1 time: 1.253053 May 31 21:03:45.558868 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 32/64] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:03:44 2022] GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8 => generated 1315 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:03:45.584320 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-e175d0be-2c61-49ba-b78d-0d3aee1d67c2 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-240959376", "imageRef": "21b89996-9e87-489d-8891-305f6c3d905a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:03:45.705549 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.network.neutron [None req-e175d0be-2c61-49ba-b78d-0d3aee1d67c2 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] validate_networks() for [('50707fc3-657a-4d1c-8628-0dfb2710b9bc', None, None, None, None, None)] {{(pid=118184) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 21:03:46.809253 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=4 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:47.448390 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell0:SELECT=4 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:48.571088 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.virt.hardware [None req-e175d0be-2c61-49ba-b78d-0d3aee1d67c2 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Flavor limits 0:0:0 {{(pid=118184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 21:03:48.572364 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.virt.hardware [None req-e175d0be-2c61-49ba-b78d-0d3aee1d67c2 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Image limits 0:0:0 {{(pid=118184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 21:03:48.573069 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.virt.hardware [None req-e175d0be-2c61-49ba-b78d-0d3aee1d67c2 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Flavor pref 0:0:0 {{(pid=118184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 21:03:48.573640 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.virt.hardware [None req-e175d0be-2c61-49ba-b78d-0d3aee1d67c2 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Image pref 0:0:0 {{(pid=118184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 21:03:48.574330 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.virt.hardware [None req-e175d0be-2c61-49ba-b78d-0d3aee1d67c2 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 21:03:48.583632 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=4 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:48.601870 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell0:SELECT=15 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:48.607102 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e175d0be-2c61-49ba-b78d-0d3aee1d67c2 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:48.608900 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e175d0be-2c61-49ba-b78d-0d3aee1d67c2 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:48.610126 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e175d0be-2c61-49ba-b78d-0d3aee1d67c2 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:48.618234 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e175d0be-2c61-49ba-b78d-0d3aee1d67c2 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:48.672371 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.quota [None req-e175d0be-2c61-49ba-b78d-0d3aee1d67c2 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Getting quotas for project f1b54ceb69fc4041b743a11eda4144a8. Resources: {'ram', 'cores', 'instances'} {{(pid=118184) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 21:03:48.686174 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.quota [None req-e175d0be-2c61-49ba-b78d-0d3aee1d67c2 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Getting quotas for user bbf377756836405d804d2aaba6e44c1f and project f1b54ceb69fc4041b743a11eda4144a8. Resources: {'ram', 'cores', 'instances'} {{(pid=118184) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 21:03:48.722041 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-e175d0be-2c61-49ba-b78d-0d3aee1d67c2 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Going to run 1 instances... {{(pid=118184) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 21:03:48.725169 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-e175d0be-2c61-49ba-b78d-0d3aee1d67c2 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 9bff085f-5477-4588-9e08-533189d2db08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='21b89996-9e87-489d-8891-305f6c3d905a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118184) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 21:03:48.878075 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-e175d0be-2c61-49ba-b78d-0d3aee1d67c2 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.317325 May 31 21:03:48.880211 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.virt.hardware [None req-f0f7f4c5-5587-47b3-b651-7885df5e4773 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Flavor limits 0:0:0 {{(pid=118185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 21:03:48.882153 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.virt.hardware [None req-f0f7f4c5-5587-47b3-b651-7885df5e4773 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Image limits 0:0:0 {{(pid=118185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 21:03:48.886482 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.virt.hardware [None req-f0f7f4c5-5587-47b3-b651-7885df5e4773 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Flavor pref 0:0:0 {{(pid=118185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 21:03:48.886482 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.virt.hardware [None req-f0f7f4c5-5587-47b3-b651-7885df5e4773 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Image pref 0:0:0 {{(pid=118185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 21:03:48.886843 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 33/65] 10.222.0.55 () {60 vars in 1146 bytes} [Tue May 31 21:03:45 2022] POST /compute/v2.1/servers => generated 383 bytes in 3324 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 31 21:03:48.886927 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.virt.hardware [None req-f0f7f4c5-5587-47b3-b651-7885df5e4773 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 21:03:48.898547 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-7d9e452f-667a-4ad7-aaf0-68e732352f1c tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:48.900140 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-7d9e452f-667a-4ad7-aaf0-68e732352f1c tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] [instance: 35c086d9-50bf-494a-90bb-694569f861a8] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:03:48.906633 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f0f7f4c5-5587-47b3-b651-7885df5e4773 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:48.907583 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f0f7f4c5-5587-47b3-b651-7885df5e4773 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:48.909236 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f0f7f4c5-5587-47b3-b651-7885df5e4773 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:48.911013 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f0f7f4c5-5587-47b3-b651-7885df5e4773 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:48.919846 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7d9e452f-667a-4ad7-aaf0-68e732352f1c tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:48.923534 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7d9e452f-667a-4ad7-aaf0-68e732352f1c tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:48.924446 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7d9e452f-667a-4ad7-aaf0-68e732352f1c tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:48.924902 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7d9e452f-667a-4ad7-aaf0-68e732352f1c tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:49.008053 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell1:SELECT=49 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:49.084456 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.quota [None req-f0f7f4c5-5587-47b3-b651-7885df5e4773 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Getting quotas for project 180ff6fd8c5b434abffa058ea99ef7c4. Resources: {'ram', 'cores', 'instances'} {{(pid=118185) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 21:03:49.132071 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.quota [None req-f0f7f4c5-5587-47b3-b651-7885df5e4773 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Getting quotas for user 92d56ad8d4ab4c1099263a3d1c43490a and project 180ff6fd8c5b434abffa058ea99ef7c4. Resources: {'ram', 'cores', 'instances'} {{(pid=118185) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 21:03:49.190845 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-f0f7f4c5-5587-47b3-b651-7885df5e4773 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Going to run 1 instances... {{(pid=118185) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 21:03:49.196835 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-f0f7f4c5-5587-47b3-b651-7885df5e4773 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='21b89996-9e87-489d-8891-305f6c3d905a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118185) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 21:03:49.431127 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-7d9e452f-667a-4ad7-aaf0-68e732352f1c tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b358c38b5a44d798f7f53c4b318134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f91ac37f864ed98a03f9082252e334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:03:49.444301 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-7d9e452f-667a-4ad7-aaf0-68e732352f1c tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] 10.222.0.55 "GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8" status: 200 len: 1315 microversion: 2.1 time: 0.559162 May 31 21:03:49.445142 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 34/66] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:03:48 2022] GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8 => generated 1315 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:03:49.448011 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-f0f7f4c5-5587-47b3-b651-7885df5e4773 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 6.165977 May 31 21:03:49.448892 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 33/67] 10.222.0.55 () {60 vars in 1146 bytes} [Tue May 31 21:03:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 6168 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 31 21:03:49.462271 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-eeed2d51-efd5-40eb-af46-c305a84e7220 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:49.463010 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-eeed2d51-efd5-40eb-af46-c305a84e7220 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 9bff085f-5477-4588-9e08-533189d2db08] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:03:49.479531 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-7d1f3a7f-bf0f-4886-85e2-7f6e43769f25 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-278629931", "imageRef": "21b89996-9e87-489d-8891-305f6c3d905a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "68e327a3-96b2-4add-895f-c43a3d5daedc"}], "security_groups": [{"name": "tempest-securitygroup--1228380061"}], "key_name": "tempest-keypair-836839230", "user_data": "}} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:03:50.083428 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-eeed2d51-efd5-40eb-af46-c305a84e7220 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:03:50.095741 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-eeed2d51-efd5-40eb-af46-c305a84e7220 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08" status: 200 len: 1221 microversion: 2.1 time: 0.639324 May 31 21:03:50.096578 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 34/68] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:03:49 2022] GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08 => generated 1221 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:03:50.109002 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-b5b43d5e-df5a-4e2d-9668-9b328d3d62fb tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:50.109002 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-b5b43d5e-df5a-4e2d-9668-9b328d3d62fb tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:03:50.208260 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.network.neutron [None req-7d1f3a7f-bf0f-4886-85e2-7f6e43769f25 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] validate_networks() for [('68e327a3-96b2-4add-895f-c43a3d5daedc', None, None, None, None, None)] {{(pid=118184) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 21:03:50.229665 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-b5b43d5e-df5a-4e2d-9668-9b328d3d62fb tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:03:50.238547 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-b5b43d5e-df5a-4e2d-9668-9b328d3d62fb tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1237 microversion: 2.1 time: 0.139831 May 31 21:03:50.239797 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 35/69] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:03:50 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1237 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:03:50.465663 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-422c884d-b796-4e14-9415-decd6d4d0980 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:50.466864 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-422c884d-b796-4e14-9415-decd6d4d0980 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] [instance: 35c086d9-50bf-494a-90bb-694569f861a8] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:03:50.477735 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-422c884d-b796-4e14-9415-decd6d4d0980 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:50.478857 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-422c884d-b796-4e14-9415-decd6d4d0980 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:50.480465 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-422c884d-b796-4e14-9415-decd6d4d0980 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:50.482123 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-422c884d-b796-4e14-9415-decd6d4d0980 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:50.945347 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-422c884d-b796-4e14-9415-decd6d4d0980 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b358c38b5a44d798f7f53c4b318134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f91ac37f864ed98a03f9082252e334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:03:50.958135 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-422c884d-b796-4e14-9415-decd6d4d0980 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] 10.222.0.55 "GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8" status: 200 len: 1315 microversion: 2.1 time: 0.500462 May 31 21:03:50.960005 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 36/70] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:03:50 2022] GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8 => generated 1315 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:03:51.114362 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-7ae050bd-1569-418e-989f-f054fb41b7e7 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:51.115711 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-7ae050bd-1569-418e-989f-f054fb41b7e7 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 9bff085f-5477-4588-9e08-533189d2db08] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:03:51.122904 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-7ae050bd-1569-418e-989f-f054fb41b7e7 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:51.123257 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-7ae050bd-1569-418e-989f-f054fb41b7e7 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:51.127418 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-7ae050bd-1569-418e-989f-f054fb41b7e7 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:51.127418 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-7ae050bd-1569-418e-989f-f054fb41b7e7 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:51.168677 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.virt.hardware [None req-7d1f3a7f-bf0f-4886-85e2-7f6e43769f25 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Flavor limits 0:0:0 {{(pid=118184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 21:03:51.169176 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.virt.hardware [None req-7d1f3a7f-bf0f-4886-85e2-7f6e43769f25 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Image limits 0:0:0 {{(pid=118184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 21:03:51.169721 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.virt.hardware [None req-7d1f3a7f-bf0f-4886-85e2-7f6e43769f25 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Flavor pref 0:0:0 {{(pid=118184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 21:03:51.170227 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.virt.hardware [None req-7d1f3a7f-bf0f-4886-85e2-7f6e43769f25 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Image pref 0:0:0 {{(pid=118184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 21:03:51.170710 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.virt.hardware [None req-7d1f3a7f-bf0f-4886-85e2-7f6e43769f25 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 21:03:51.180542 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7d1f3a7f-bf0f-4886-85e2-7f6e43769f25 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:51.181091 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7d1f3a7f-bf0f-4886-85e2-7f6e43769f25 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:51.182094 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7d1f3a7f-bf0f-4886-85e2-7f6e43769f25 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:51.182642 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7d1f3a7f-bf0f-4886-85e2-7f6e43769f25 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:51.199769 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-7ae050bd-1569-418e-989f-f054fb41b7e7 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:03:51.201383 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.quota [None req-7d1f3a7f-bf0f-4886-85e2-7f6e43769f25 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Getting quotas for project af420d43367c42e4a4b0948706dd0546. Resources: {'ram', 'cores', 'instances'} {{(pid=118184) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 21:03:51.208024 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.quota [None req-7d1f3a7f-bf0f-4886-85e2-7f6e43769f25 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Getting quotas for user 2d69edafe80649d4aff602b692e294c8 and project af420d43367c42e4a4b0948706dd0546. Resources: {'ram', 'cores', 'instances'} {{(pid=118184) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 21:03:51.208957 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-7ae050bd-1569-418e-989f-f054fb41b7e7 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08" status: 200 len: 1225 microversion: 2.1 time: 0.098504 May 31 21:03:51.209918 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 37/71] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:03:51 2022] GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:03:51.235452 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-7d1f3a7f-bf0f-4886-85e2-7f6e43769f25 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Going to run 1 instances... {{(pid=118184) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 21:03:51.237935 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-7d1f3a7f-bf0f-4886-85e2-7f6e43769f25 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='21b89996-9e87-489d-8891-305f6c3d905a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118184) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 21:03:51.256683 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-ae20c7cd-e43f-42b4-86bf-899f7acedd49 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:51.257546 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-ae20c7cd-e43f-42b4-86bf-899f7acedd49 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:03:51.311864 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-ae20c7cd-e43f-42b4-86bf-899f7acedd49 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:03:51.319193 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-ae20c7cd-e43f-42b4-86bf-899f7acedd49 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1237 microversion: 2.1 time: 0.066288 May 31 21:03:51.319877 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 38/72] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:03:51 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1237 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:03:51.567913 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-7d1f3a7f-bf0f-4886-85e2-7f6e43769f25 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.104914 May 31 21:03:51.570252 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 35/73] 10.222.0.55 () {62 vars in 1187 bytes} [Tue May 31 21:03:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 2125 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 31 21:03:51.581081 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-a72ec2e7-55f5-452c-9df3-e85169f4619d tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:51.581769 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-a72ec2e7-55f5-452c-9df3-e85169f4619d tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:03:51.673235 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-a72ec2e7-55f5-452c-9df3-e85169f4619d tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:03:51.684371 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-a72ec2e7-55f5-452c-9df3-e85169f4619d tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:03:51.686666 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-a72ec2e7-55f5-452c-9df3-e85169f4619d tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:03:51.687809 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-a72ec2e7-55f5-452c-9df3-e85169f4619d tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1280 microversion: 2.20 time: 0.111217 May 31 21:03:51.688510 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 39/74] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:03:51 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1280 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:03:51.988157 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-3355b2e7-1fc4-40af-b4de-ff8bb2f3a1c0 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:51.988725 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-3355b2e7-1fc4-40af-b4de-ff8bb2f3a1c0 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] [instance: 35c086d9-50bf-494a-90bb-694569f861a8] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:03:51.996158 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-3355b2e7-1fc4-40af-b4de-ff8bb2f3a1c0 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:51.996615 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-3355b2e7-1fc4-40af-b4de-ff8bb2f3a1c0 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:51.997397 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-3355b2e7-1fc4-40af-b4de-ff8bb2f3a1c0 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:51.997837 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-3355b2e7-1fc4-40af-b4de-ff8bb2f3a1c0 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:52.179166 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-3355b2e7-1fc4-40af-b4de-ff8bb2f3a1c0 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b358c38b5a44d798f7f53c4b318134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f91ac37f864ed98a03f9082252e334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:03:52.186583 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-3355b2e7-1fc4-40af-b4de-ff8bb2f3a1c0 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] 10.222.0.55 "GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8" status: 200 len: 1315 microversion: 2.1 time: 0.202570 May 31 21:03:52.187155 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 36/75] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:03:51 2022] GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8 => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:03:52.226886 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-a8c020a7-f9d4-4d00-90fd-22f7e01ad3aa tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:52.227412 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-a8c020a7-f9d4-4d00-90fd-22f7e01ad3aa tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 9bff085f-5477-4588-9e08-533189d2db08] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:03:52.233289 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a8c020a7-f9d4-4d00-90fd-22f7e01ad3aa tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:52.233764 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a8c020a7-f9d4-4d00-90fd-22f7e01ad3aa tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:52.234529 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a8c020a7-f9d4-4d00-90fd-22f7e01ad3aa tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:52.234961 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a8c020a7-f9d4-4d00-90fd-22f7e01ad3aa tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:52.299787 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-a8c020a7-f9d4-4d00-90fd-22f7e01ad3aa tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:03:52.308217 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-a8c020a7-f9d4-4d00-90fd-22f7e01ad3aa tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08" status: 200 len: 1217 microversion: 2.1 time: 0.086038 May 31 21:03:52.309084 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 40/76] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:03:52 2022] GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08 => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:03:52.341326 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-5308c7e3-56b9-4dad-b98c-53864f5d681b tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:52.342009 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-5308c7e3-56b9-4dad-b98c-53864f5d681b tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:03:52.348815 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5308c7e3-56b9-4dad-b98c-53864f5d681b tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:52.349353 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5308c7e3-56b9-4dad-b98c-53864f5d681b tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:52.351198 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5308c7e3-56b9-4dad-b98c-53864f5d681b tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:52.351664 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5308c7e3-56b9-4dad-b98c-53864f5d681b tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:52.434687 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-5308c7e3-56b9-4dad-b98c-53864f5d681b tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:03:52.449416 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-5308c7e3-56b9-4dad-b98c-53864f5d681b tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1241 microversion: 2.1 time: 0.115549 May 31 21:03:52.460594 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 37/77] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:03:52 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1241 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:03:52.717811 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-66682684-70dc-425e-9c71-caefb075b4ee tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:52.718525 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-66682684-70dc-425e-9c71-caefb075b4ee tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:03:52.777756 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-66682684-70dc-425e-9c71-caefb075b4ee tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:03:52.791260 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-66682684-70dc-425e-9c71-caefb075b4ee tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:03:52.793238 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-66682684-70dc-425e-9c71-caefb075b4ee tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:03:52.794788 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-66682684-70dc-425e-9c71-caefb075b4ee tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1280 microversion: 2.20 time: 0.081136 May 31 21:03:52.795435 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 41/78] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:03:52 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1280 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:03:53.207478 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-00137655-5496-4fde-9526-25d543390a25 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:53.208797 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-00137655-5496-4fde-9526-25d543390a25 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] [instance: 35c086d9-50bf-494a-90bb-694569f861a8] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:03:53.221067 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-00137655-5496-4fde-9526-25d543390a25 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:53.222355 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-00137655-5496-4fde-9526-25d543390a25 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:53.223134 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-00137655-5496-4fde-9526-25d543390a25 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:53.224114 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-00137655-5496-4fde-9526-25d543390a25 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:53.325954 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-5e6b9d71-e987-41a1-94ff-86e3e29e0d02 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:53.327147 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-5e6b9d71-e987-41a1-94ff-86e3e29e0d02 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 9bff085f-5477-4588-9e08-533189d2db08] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:03:53.334803 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-5e6b9d71-e987-41a1-94ff-86e3e29e0d02 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:53.335496 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-5e6b9d71-e987-41a1-94ff-86e3e29e0d02 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:53.336888 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-5e6b9d71-e987-41a1-94ff-86e3e29e0d02 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:53.337792 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-5e6b9d71-e987-41a1-94ff-86e3e29e0d02 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:53.445979 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-5e6b9d71-e987-41a1-94ff-86e3e29e0d02 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:03:53.456050 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-5e6b9d71-e987-41a1-94ff-86e3e29e0d02 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08" status: 200 len: 1217 microversion: 2.1 time: 0.133868 May 31 21:03:53.467163 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 42/79] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:03:53 2022] GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08 => generated 1217 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:03:53.474222 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-24ab4f21-7f50-466d-95ee-f9c344930981 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:53.474874 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-24ab4f21-7f50-466d-95ee-f9c344930981 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:03:53.481949 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-24ab4f21-7f50-466d-95ee-f9c344930981 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:53.482663 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-24ab4f21-7f50-466d-95ee-f9c344930981 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:53.483885 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-24ab4f21-7f50-466d-95ee-f9c344930981 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:53.484614 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-24ab4f21-7f50-466d-95ee-f9c344930981 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:53.489744 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-00137655-5496-4fde-9526-25d543390a25 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b358c38b5a44d798f7f53c4b318134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f91ac37f864ed98a03f9082252e334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:03:53.497760 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-00137655-5496-4fde-9526-25d543390a25 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] 10.222.0.55 "GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8" status: 200 len: 1315 microversion: 2.1 time: 0.297983 May 31 21:03:53.507166 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 38/80] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:03:53 2022] GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8 => generated 1315 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:03:53.551990 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-24ab4f21-7f50-466d-95ee-f9c344930981 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:03:53.558871 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-24ab4f21-7f50-466d-95ee-f9c344930981 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1241 microversion: 2.1 time: 0.090430 May 31 21:03:53.559489 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 43/81] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:03:53 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1241 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:03:53.816565 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-ab3d9112-c5c6-4604-b5a1-12c389ccd38d tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:53.820599 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-ab3d9112-c5c6-4604-b5a1-12c389ccd38d tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:03:53.871829 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-ab3d9112-c5c6-4604-b5a1-12c389ccd38d tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:03:53.879053 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-ab3d9112-c5c6-4604-b5a1-12c389ccd38d tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:03:53.881000 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-ab3d9112-c5c6-4604-b5a1-12c389ccd38d tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:03:53.882146 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-ab3d9112-c5c6-4604-b5a1-12c389ccd38d tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1280 microversion: 2.20 time: 0.071995 May 31 21:03:53.882738 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 39/82] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:03:53 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1280 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:03:54.473776 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-683fc664-bccd-4f65-9f0e-7aadac444e8c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:54.475161 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-683fc664-bccd-4f65-9f0e-7aadac444e8c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 9bff085f-5477-4588-9e08-533189d2db08] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:03:54.502595 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-683fc664-bccd-4f65-9f0e-7aadac444e8c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:54.504806 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-683fc664-bccd-4f65-9f0e-7aadac444e8c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:54.507664 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-683fc664-bccd-4f65-9f0e-7aadac444e8c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:54.509601 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-683fc664-bccd-4f65-9f0e-7aadac444e8c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:54.524452 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-64cd567e-6eef-4762-a795-041fe97e6263 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:54.525771 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-64cd567e-6eef-4762-a795-041fe97e6263 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] [instance: 35c086d9-50bf-494a-90bb-694569f861a8] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:03:54.537598 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-64cd567e-6eef-4762-a795-041fe97e6263 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:54.540724 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-64cd567e-6eef-4762-a795-041fe97e6263 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:54.541858 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-64cd567e-6eef-4762-a795-041fe97e6263 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:54.543368 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-64cd567e-6eef-4762-a795-041fe97e6263 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:54.896321 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-683fc664-bccd-4f65-9f0e-7aadac444e8c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:03:54.928689 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-683fc664-bccd-4f65-9f0e-7aadac444e8c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08" status: 200 len: 1273 microversion: 2.1 time: 0.458793 May 31 21:03:54.930944 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 44/83] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:03:54 2022] GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08 => generated 1273 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:03:54.942846 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-f0e74c7d-1272-4909-87a1-d2a0e9583202 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:54.978850 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-f0e74c7d-1272-4909-87a1-d2a0e9583202 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:03:55.030503 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f0e74c7d-1272-4909-87a1-d2a0e9583202 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:55.031411 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f0e74c7d-1272-4909-87a1-d2a0e9583202 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:55.035628 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f0e74c7d-1272-4909-87a1-d2a0e9583202 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:55.037801 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f0e74c7d-1272-4909-87a1-d2a0e9583202 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:55.258998 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-64cd567e-6eef-4762-a795-041fe97e6263 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b358c38b5a44d798f7f53c4b318134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f91ac37f864ed98a03f9082252e334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:03:55.273096 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-f0e74c7d-1272-4909-87a1-d2a0e9583202 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:03:55.274919 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-64cd567e-6eef-4762-a795-041fe97e6263 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] 10.222.0.55 "GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8" status: 200 len: 1315 microversion: 2.1 time: 0.755520 May 31 21:03:55.275951 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 40/84] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:03:54 2022] GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8 => generated 1315 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:03:55.289322 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-734a5792-5e2d-408b-952b-bc550270194f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:55.289958 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-734a5792-5e2d-408b-952b-bc550270194f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:03:55.296698 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-f0e74c7d-1272-4909-87a1-d2a0e9583202 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1233 microversion: 2.1 time: 0.363739 May 31 21:03:55.297595 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 45/85] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:03:54 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1233 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:03:55.308170 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-734a5792-5e2d-408b-952b-bc550270194f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:55.308777 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-734a5792-5e2d-408b-952b-bc550270194f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:55.309627 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-734a5792-5e2d-408b-952b-bc550270194f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:55.310190 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-734a5792-5e2d-408b-952b-bc550270194f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:55.438754 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-734a5792-5e2d-408b-952b-bc550270194f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:03:55.453147 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-734a5792-5e2d-408b-952b-bc550270194f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:03:55.455485 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-734a5792-5e2d-408b-952b-bc550270194f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:03:55.458471 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-734a5792-5e2d-408b-952b-bc550270194f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1332 microversion: 2.20 time: 0.180866 May 31 21:03:55.459870 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 41/86] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:03:55 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1332 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:03:55.737242 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [req-0ba9f10c-8c7c-4a8e-b405-563946761558 req-f35ca235-a53d-4342-bd29-c12337454f34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24059932-87a0-4e56-8bb0-4797276e2042", "tag": "d441d5e6-2812-4d1f-bf38-96cb2c781ded"}]} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:03:55.751130 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-0ba9f10c-8c7c-4a8e-b405-563946761558 req-f35ca235-a53d-4342-bd29-c12337454f34 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:55.754630 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-0ba9f10c-8c7c-4a8e-b405-563946761558 req-f35ca235-a53d-4342-bd29-c12337454f34 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:55.778733 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.compute.server_external_events [req-0ba9f10c-8c7c-4a8e-b405-563946761558 req-f35ca235-a53d-4342-bd29-c12337454f34 service nova] Creating event network-changed:d441d5e6-2812-4d1f-bf38-96cb2c781ded for instance 24059932-87a0-4e56-8bb0-4797276e2042 on hv-cinder-83979 May 31 21:03:55.788485 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [req-0ba9f10c-8c7c-4a8e-b405-563946761558 req-f35ca235-a53d-4342-bd29-c12337454f34 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054599 May 31 21:03:55.789837 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 46/87] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:03:55.949540 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-0f35e5d1-e67e-4439-9448-0edcdc9ca736 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:55.950187 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-0f35e5d1-e67e-4439-9448-0edcdc9ca736 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 9bff085f-5477-4588-9e08-533189d2db08] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:03:55.958430 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-0f35e5d1-e67e-4439-9448-0edcdc9ca736 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:55.959929 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-0f35e5d1-e67e-4439-9448-0edcdc9ca736 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:55.960797 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-0f35e5d1-e67e-4439-9448-0edcdc9ca736 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:55.965479 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-0f35e5d1-e67e-4439-9448-0edcdc9ca736 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:56.160979 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-0f35e5d1-e67e-4439-9448-0edcdc9ca736 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:03:56.189046 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-0f35e5d1-e67e-4439-9448-0edcdc9ca736 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08" status: 200 len: 1291 microversion: 2.1 time: 0.240829 May 31 21:03:56.193056 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 42/88] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:03:55 2022] GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08 => generated 1291 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:03:56.300663 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-8957bece-7a57-4ff9-899d-f4b9303cea5b tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:56.306743 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-8957bece-7a57-4ff9-899d-f4b9303cea5b tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] [instance: 35c086d9-50bf-494a-90bb-694569f861a8] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:03:56.316808 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-cec7025a-4011-4dd7-9662-8c0aea664903 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:56.317883 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-cec7025a-4011-4dd7-9662-8c0aea664903 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:03:56.338206 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-cec7025a-4011-4dd7-9662-8c0aea664903 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:56.340334 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-cec7025a-4011-4dd7-9662-8c0aea664903 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:56.342958 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-8957bece-7a57-4ff9-899d-f4b9303cea5b tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:56.343767 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-8957bece-7a57-4ff9-899d-f4b9303cea5b tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:56.344623 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-cec7025a-4011-4dd7-9662-8c0aea664903 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:56.345733 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-8957bece-7a57-4ff9-899d-f4b9303cea5b tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:56.346457 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-cec7025a-4011-4dd7-9662-8c0aea664903 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:56.353172 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-8957bece-7a57-4ff9-899d-f4b9303cea5b tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:56.664797 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-cec7025a-4011-4dd7-9662-8c0aea664903 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:03:56.677315 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-cec7025a-4011-4dd7-9662-8c0aea664903 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1297 microversion: 2.1 time: 0.365192 May 31 21:03:56.690993 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 43/89] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:03:56 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1297 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:03:56.713731 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-5ab7c73d-b65b-485a-ae2c-deb05e7e3f37 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:56.722995 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-5ab7c73d-b65b-485a-ae2c-deb05e7e3f37 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:03:56.730856 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5ab7c73d-b65b-485a-ae2c-deb05e7e3f37 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:56.732979 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5ab7c73d-b65b-485a-ae2c-deb05e7e3f37 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:56.734864 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5ab7c73d-b65b-485a-ae2c-deb05e7e3f37 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:56.736441 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5ab7c73d-b65b-485a-ae2c-deb05e7e3f37 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:56.932582 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-5ab7c73d-b65b-485a-ae2c-deb05e7e3f37 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:03:56.944286 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-5ab7c73d-b65b-485a-ae2c-deb05e7e3f37 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:03:56.951319 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-5ab7c73d-b65b-485a-ae2c-deb05e7e3f37 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:03:56.951319 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-5ab7c73d-b65b-485a-ae2c-deb05e7e3f37 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1350 microversion: 2.20 time: 0.257073 May 31 21:03:56.951319 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 44/90] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:03:56 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1350 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:03:57.209076 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-2751a948-51dc-4c38-a196-82ba6da3a584 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:57.211722 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-2751a948-51dc-4c38-a196-82ba6da3a584 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 9bff085f-5477-4588-9e08-533189d2db08] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:03:57.218962 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2751a948-51dc-4c38-a196-82ba6da3a584 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:57.219699 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2751a948-51dc-4c38-a196-82ba6da3a584 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:57.220466 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2751a948-51dc-4c38-a196-82ba6da3a584 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:57.220940 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2751a948-51dc-4c38-a196-82ba6da3a584 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:57.224205 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-8957bece-7a57-4ff9-899d-f4b9303cea5b tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b358c38b5a44d798f7f53c4b318134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f91ac37f864ed98a03f9082252e334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:03:57.233329 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-8957bece-7a57-4ff9-899d-f4b9303cea5b tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] 10.222.0.55 "GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8" status: 200 len: 1315 microversion: 2.1 time: 0.943136 May 31 21:03:57.233951 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 47/91] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:03:56 2022] GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8 => generated 1315 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:03:57.389142 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-2751a948-51dc-4c38-a196-82ba6da3a584 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:03:57.413560 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-2751a948-51dc-4c38-a196-82ba6da3a584 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08" status: 200 len: 1279 microversion: 2.1 time: 0.206890 May 31 21:03:57.464866 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 45/92] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:03:57 2022] GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08 => generated 1279 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:03:57.713062 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-b07ea840-0608-4985-a011-7ea975ec2d2f tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:57.714243 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-b07ea840-0608-4985-a011-7ea975ec2d2f tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:03:57.733458 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b07ea840-0608-4985-a011-7ea975ec2d2f tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:57.741567 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b07ea840-0608-4985-a011-7ea975ec2d2f tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:57.743242 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b07ea840-0608-4985-a011-7ea975ec2d2f tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:57.744311 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b07ea840-0608-4985-a011-7ea975ec2d2f tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:57.974851 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-6a20441c-80e0-43cb-a67c-7db717516163 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:57.976700 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-6a20441c-80e0-43cb-a67c-7db717516163 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:03:57.998010 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6a20441c-80e0-43cb-a67c-7db717516163 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:57.999554 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6a20441c-80e0-43cb-a67c-7db717516163 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:58.000907 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6a20441c-80e0-43cb-a67c-7db717516163 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:58.004641 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6a20441c-80e0-43cb-a67c-7db717516163 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:58.156709 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-b07ea840-0608-4985-a011-7ea975ec2d2f tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:03:58.167428 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-b07ea840-0608-4985-a011-7ea975ec2d2f tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1295 microversion: 2.1 time: 0.460944 May 31 21:03:58.178741 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 48/93] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:03:57 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1295 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:03:58.246728 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-6a20441c-80e0-43cb-a67c-7db717516163 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:03:58.266673 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-6a20441c-80e0-43cb-a67c-7db717516163 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:03:58.268241 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-6a20441c-80e0-43cb-a67c-7db717516163 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:03:58.269399 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-6a20441c-80e0-43cb-a67c-7db717516163 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1338 microversion: 2.20 time: 0.304651 May 31 21:03:58.274040 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 46/94] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:03:57 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1338 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 21:03:58.284921 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-292a3914-2d41-4747-876b-80af8cd80cea tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:58.289617 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-292a3914-2d41-4747-876b-80af8cd80cea tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] [instance: 35c086d9-50bf-494a-90bb-694569f861a8] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:03:58.300376 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-292a3914-2d41-4747-876b-80af8cd80cea tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:58.301340 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-292a3914-2d41-4747-876b-80af8cd80cea tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:58.302530 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-292a3914-2d41-4747-876b-80af8cd80cea tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:58.303284 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-292a3914-2d41-4747-876b-80af8cd80cea tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:58.497218 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [req-202e2427-7a47-4ee5-b17a-4a3463a07be6 req-fb8c10b8-21c4-43f8-add2-353b44263a7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35c086d9-50bf-494a-90bb-694569f861a8", "name": "network-vif-plugged", "status": "completed", "tag": "837c9641-8167-4561-b45f-1b48acf21abc"}]} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:03:58.534807 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-202e2427-7a47-4ee5-b17a-4a3463a07be6 req-fb8c10b8-21c4-43f8-add2-353b44263a7e service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:58.538875 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-202e2427-7a47-4ee5-b17a-4a3463a07be6 req-fb8c10b8-21c4-43f8-add2-353b44263a7e service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:58.572856 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.compute.server_external_events [req-202e2427-7a47-4ee5-b17a-4a3463a07be6 req-fb8c10b8-21c4-43f8-add2-353b44263a7e service nova] Creating event network-vif-plugged:837c9641-8167-4561-b45f-1b48acf21abc for instance 35c086d9-50bf-494a-90bb-694569f861a8 on hv-cinder-83979 May 31 21:03:58.573607 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-202e2427-7a47-4ee5-b17a-4a3463a07be6 req-fb8c10b8-21c4-43f8-add2-353b44263a7e service nova] Acquired lock "compute-rpcapi-router" {{(pid=118184) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 31 21:03:58.575738 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7f7f0809-165a-46bf-a390-8735fa0fd969 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:58.576492 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7f7f0809-165a-46bf-a390-8735fa0fd969 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:58.577440 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7f7f0809-165a-46bf-a390-8735fa0fd969 None None] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:58.578336 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7f7f0809-165a-46bf-a390-8735fa0fd969 None None] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:58.597080 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.compute.rpcapi [None req-7f7f0809-165a-46bf-a390-8735fa0fd969 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 31 21:03:58.598164 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7f7f0809-165a-46bf-a390-8735fa0fd969 None None] Releasing lock "compute-rpcapi-router" {{(pid=118184) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 31 21:03:58.634688 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-7f7f0809-165a-46bf-a390-8735fa0fd969 None None] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.242162 May 31 21:03:58.647300 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 47/95] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:03:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 21:03:58.684612 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-7c2528ed-5b09-451a-9a85-26539fda0d33 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:58.686409 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-7c2528ed-5b09-451a-9a85-26539fda0d33 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 9bff085f-5477-4588-9e08-533189d2db08] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:03:58.715254 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7c2528ed-5b09-451a-9a85-26539fda0d33 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:58.715860 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7c2528ed-5b09-451a-9a85-26539fda0d33 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:58.716798 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7c2528ed-5b09-451a-9a85-26539fda0d33 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:58.717322 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7c2528ed-5b09-451a-9a85-26539fda0d33 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:59.009343 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell0:SELECT=4 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:59.170416 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-292a3914-2d41-4747-876b-80af8cd80cea tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b358c38b5a44d798f7f53c4b318134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f91ac37f864ed98a03f9082252e334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:03:59.183376 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-292a3914-2d41-4747-876b-80af8cd80cea tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] 10.222.0.55 "GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8" status: 200 len: 1315 microversion: 2.1 time: 0.931634 May 31 21:03:59.196489 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 49/96] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:03:58 2022] GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8 => generated 1315 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:03:59.201944 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-1f53415d-f171-41f7-a9b6-8d22f5cb2e4a tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:59.204270 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-1f53415d-f171-41f7-a9b6-8d22f5cb2e4a tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:03:59.214237 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-1f53415d-f171-41f7-a9b6-8d22f5cb2e4a tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:59.214580 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-1f53415d-f171-41f7-a9b6-8d22f5cb2e4a tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:59.215416 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-1f53415d-f171-41f7-a9b6-8d22f5cb2e4a tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:59.216336 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-1f53415d-f171-41f7-a9b6-8d22f5cb2e4a tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:59.413567 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-1f53415d-f171-41f7-a9b6-8d22f5cb2e4a tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:03:59.430854 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-1f53415d-f171-41f7-a9b6-8d22f5cb2e4a tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1295 microversion: 2.1 time: 0.233019 May 31 21:03:59.441466 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 50/97] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:03:59 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1295 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:03:59.446657 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-a7ca8687-428c-4cac-9d7e-cbb2db3876a2 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:03:59.448063 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-a7ca8687-428c-4cac-9d7e-cbb2db3876a2 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:03:59.455551 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a7ca8687-428c-4cac-9d7e-cbb2db3876a2 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:59.456168 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a7ca8687-428c-4cac-9d7e-cbb2db3876a2 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:59.456577 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-7c2528ed-5b09-451a-9a85-26539fda0d33 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:03:59.457796 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a7ca8687-428c-4cac-9d7e-cbb2db3876a2 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:03:59.458407 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a7ca8687-428c-4cac-9d7e-cbb2db3876a2 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:03:59.466590 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-7c2528ed-5b09-451a-9a85-26539fda0d33 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08" status: 200 len: 1321 microversion: 2.1 time: 0.816917 May 31 21:03:59.467501 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 48/98] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:03:58 2022] GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08 => generated 1321 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:03:59.691667 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-a7ca8687-428c-4cac-9d7e-cbb2db3876a2 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:03:59.703447 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-a7ca8687-428c-4cac-9d7e-cbb2db3876a2 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:03:59.704964 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-a7ca8687-428c-4cac-9d7e-cbb2db3876a2 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:03:59.706108 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-a7ca8687-428c-4cac-9d7e-cbb2db3876a2 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1406 microversion: 2.20 time: 0.263310 May 31 21:03:59.706680 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 51/99] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:03:59 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1406 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:04:00.211285 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-0c301088-c428-4953-9e44-e260f6cb71e3 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:00.211285 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-0c301088-c428-4953-9e44-e260f6cb71e3 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] [instance: 35c086d9-50bf-494a-90bb-694569f861a8] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:00.220819 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-0c301088-c428-4953-9e44-e260f6cb71e3 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:00.223024 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-0c301088-c428-4953-9e44-e260f6cb71e3 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:00.225577 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-0c301088-c428-4953-9e44-e260f6cb71e3 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:00.230671 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-0c301088-c428-4953-9e44-e260f6cb71e3 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:00.381643 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [req-e611cc64-4022-43d5-a6e9-4e0174859ebe req-0056cf0d-b769-4abd-8ec8-0285921e68f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bff085f-5477-4588-9e08-533189d2db08", "tag": "31db06ed-717e-4c7e-8538-117ccbffa87d"}]} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:04:00.390427 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-e611cc64-4022-43d5-a6e9-4e0174859ebe req-0056cf0d-b769-4abd-8ec8-0285921e68f4 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:00.390829 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-e611cc64-4022-43d5-a6e9-4e0174859ebe req-0056cf0d-b769-4abd-8ec8-0285921e68f4 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:00.402959 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.compute.server_external_events [req-e611cc64-4022-43d5-a6e9-4e0174859ebe req-0056cf0d-b769-4abd-8ec8-0285921e68f4 service nova] Creating event network-changed:31db06ed-717e-4c7e-8538-117ccbffa87d for instance 9bff085f-5477-4588-9e08-533189d2db08 on hv-cinder-83979 May 31 21:04:00.408072 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [req-e611cc64-4022-43d5-a6e9-4e0174859ebe req-0056cf0d-b769-4abd-8ec8-0285921e68f4 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094427 May 31 21:04:00.408685 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 52/100] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:04:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:04:00.432716 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-0c301088-c428-4953-9e44-e260f6cb71e3 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b358c38b5a44d798f7f53c4b318134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f91ac37f864ed98a03f9082252e334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:00.444850 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-0c301088-c428-4953-9e44-e260f6cb71e3 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] 10.222.0.55 "GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8" status: 200 len: 1315 microversion: 2.1 time: 0.247314 May 31 21:04:00.455154 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-c00c4197-af10-4acd-8fc1-217c8049c4b9 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:00.456030 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 49/101] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:00 2022] GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8 => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:04:00.467315 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-c00c4197-af10-4acd-8fc1-217c8049c4b9 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:00.483742 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c00c4197-af10-4acd-8fc1-217c8049c4b9 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:00.484193 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c00c4197-af10-4acd-8fc1-217c8049c4b9 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:00.484979 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c00c4197-af10-4acd-8fc1-217c8049c4b9 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:00.485445 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c00c4197-af10-4acd-8fc1-217c8049c4b9 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:00.486128 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-2a870316-67b2-49f3-8ae2-9a9f188f7102 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:00.487700 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-2a870316-67b2-49f3-8ae2-9a9f188f7102 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 9bff085f-5477-4588-9e08-533189d2db08] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:00.498780 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2a870316-67b2-49f3-8ae2-9a9f188f7102 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:00.499575 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2a870316-67b2-49f3-8ae2-9a9f188f7102 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:00.500860 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2a870316-67b2-49f3-8ae2-9a9f188f7102 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:00.502399 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2a870316-67b2-49f3-8ae2-9a9f188f7102 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:00.872508 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-c00c4197-af10-4acd-8fc1-217c8049c4b9 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:00.879961 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-2a870316-67b2-49f3-8ae2-9a9f188f7102 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:00.882823 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-c00c4197-af10-4acd-8fc1-217c8049c4b9 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1363 microversion: 2.1 time: 0.437239 May 31 21:04:00.885105 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 53/102] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:00 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1363 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:04:00.886082 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell1:SELECT=100 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:00.893120 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-2a870316-67b2-49f3-8ae2-9a9f188f7102 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08" status: 200 len: 1321 microversion: 2.1 time: 0.413015 May 31 21:04:00.895987 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 50/103] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:00 2022] GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08 => generated 1321 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:04:00.898681 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-6d921cce-706d-4623-a513-d1b360f3aff6 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:00.899298 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-6d921cce-706d-4623-a513-d1b360f3aff6 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:00.905702 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-6d921cce-706d-4623-a513-d1b360f3aff6 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:00.906184 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-6d921cce-706d-4623-a513-d1b360f3aff6 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:00.906957 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-6d921cce-706d-4623-a513-d1b360f3aff6 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:00.907399 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-6d921cce-706d-4623-a513-d1b360f3aff6 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:01.217448 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-6d921cce-706d-4623-a513-d1b360f3aff6 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:01.226838 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-6d921cce-706d-4623-a513-d1b360f3aff6 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:01.228458 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-6d921cce-706d-4623-a513-d1b360f3aff6 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:01.229594 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-6d921cce-706d-4623-a513-d1b360f3aff6 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1406 microversion: 2.20 time: 0.335441 May 31 21:04:01.231442 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 54/104] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:04:00 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1406 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:04:01.464467 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-c71ffd0e-e281-48b0-bc50-4593eab04f2c tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:01.465162 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-c71ffd0e-e281-48b0-bc50-4593eab04f2c tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] [instance: 35c086d9-50bf-494a-90bb-694569f861a8] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:01.471548 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c71ffd0e-e281-48b0-bc50-4593eab04f2c tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:01.471997 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c71ffd0e-e281-48b0-bc50-4593eab04f2c tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:01.472789 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c71ffd0e-e281-48b0-bc50-4593eab04f2c tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:01.473222 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c71ffd0e-e281-48b0-bc50-4593eab04f2c tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:01.641399 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-c71ffd0e-e281-48b0-bc50-4593eab04f2c tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b358c38b5a44d798f7f53c4b318134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f91ac37f864ed98a03f9082252e334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:01.649512 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-c71ffd0e-e281-48b0-bc50-4593eab04f2c tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] 10.222.0.55 "GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8" status: 200 len: 1315 microversion: 2.1 time: 0.188867 May 31 21:04:01.650578 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 51/105] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:01 2022] GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8 => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:04:01.899524 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-00891d6f-fe8e-4e73-8139-e53d2dec3b71 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:01.900128 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-00891d6f-fe8e-4e73-8139-e53d2dec3b71 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:01.906414 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-00891d6f-fe8e-4e73-8139-e53d2dec3b71 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:01.906867 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-00891d6f-fe8e-4e73-8139-e53d2dec3b71 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:01.907632 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-00891d6f-fe8e-4e73-8139-e53d2dec3b71 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:01.908068 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-00891d6f-fe8e-4e73-8139-e53d2dec3b71 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:01.910895 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-3b102167-b546-4c02-adab-0f3df54ae45c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:01.911497 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-3b102167-b546-4c02-adab-0f3df54ae45c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 9bff085f-5477-4588-9e08-533189d2db08] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:01.918188 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-3b102167-b546-4c02-adab-0f3df54ae45c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:01.918637 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-3b102167-b546-4c02-adab-0f3df54ae45c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:01.919406 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-3b102167-b546-4c02-adab-0f3df54ae45c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:01.919832 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-3b102167-b546-4c02-adab-0f3df54ae45c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:02.113732 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-00891d6f-fe8e-4e73-8139-e53d2dec3b71 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:02.121613 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-00891d6f-fe8e-4e73-8139-e53d2dec3b71 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1363 microversion: 2.1 time: 0.226283 May 31 21:04:02.130301 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 55/106] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:01 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1363 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:04:02.200604 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-3b102167-b546-4c02-adab-0f3df54ae45c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:02.208295 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-3b102167-b546-4c02-adab-0f3df54ae45c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08" status: 200 len: 1321 microversion: 2.1 time: 0.301141 May 31 21:04:02.208861 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 52/107] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:01 2022] GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08 => generated 1321 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:04:02.247204 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-9f4f9a74-f2c3-4ac5-8154-9a5c8651d7e0 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:02.247815 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-9f4f9a74-f2c3-4ac5-8154-9a5c8651d7e0 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:02.253795 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9f4f9a74-f2c3-4ac5-8154-9a5c8651d7e0 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:02.254281 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9f4f9a74-f2c3-4ac5-8154-9a5c8651d7e0 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:02.255058 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9f4f9a74-f2c3-4ac5-8154-9a5c8651d7e0 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:02.255495 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9f4f9a74-f2c3-4ac5-8154-9a5c8651d7e0 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:02.423258 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [req-9fbf733b-1dda-46fd-959f-0b39f7f67bfb req-be55d253-fcb5-4c61-92cb-62289749baa2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a123764b-4693-41b1-bad8-a1a63cc951cd", "tag": "cc0edf95-fc02-451a-b38f-075bee275ed6"}]} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:04:02.434419 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-9fbf733b-1dda-46fd-959f-0b39f7f67bfb req-be55d253-fcb5-4c61-92cb-62289749baa2 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:02.435033 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-9fbf733b-1dda-46fd-959f-0b39f7f67bfb req-be55d253-fcb5-4c61-92cb-62289749baa2 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:02.448123 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.compute.server_external_events [req-9fbf733b-1dda-46fd-959f-0b39f7f67bfb req-be55d253-fcb5-4c61-92cb-62289749baa2 service nova] Creating event network-changed:cc0edf95-fc02-451a-b38f-075bee275ed6 for instance a123764b-4693-41b1-bad8-a1a63cc951cd on hv-cinder-83979 May 31 21:04:02.454619 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [req-9fbf733b-1dda-46fd-959f-0b39f7f67bfb req-be55d253-fcb5-4c61-92cb-62289749baa2 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035061 May 31 21:04:02.456943 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 53/108] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:04:02.581019 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-9f4f9a74-f2c3-4ac5-8154-9a5c8651d7e0 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:02.583433 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell1:SELECT=100 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:02.589582 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-9f4f9a74-f2c3-4ac5-8154-9a5c8651d7e0 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:02.591102 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-9f4f9a74-f2c3-4ac5-8154-9a5c8651d7e0 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:02.592186 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-9f4f9a74-f2c3-4ac5-8154-9a5c8651d7e0 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1406 microversion: 2.20 time: 0.348886 May 31 21:04:02.592735 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 56/109] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:04:02 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1406 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:04:02.667655 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-15d1a43a-1040-47e5-8f3e-aac2bf62be8c tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:02.668519 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-15d1a43a-1040-47e5-8f3e-aac2bf62be8c tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] [instance: 35c086d9-50bf-494a-90bb-694569f861a8] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:02.675062 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-15d1a43a-1040-47e5-8f3e-aac2bf62be8c tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:02.675585 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-15d1a43a-1040-47e5-8f3e-aac2bf62be8c tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:02.676353 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-15d1a43a-1040-47e5-8f3e-aac2bf62be8c tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:02.676945 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-15d1a43a-1040-47e5-8f3e-aac2bf62be8c tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:02.820503 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-15d1a43a-1040-47e5-8f3e-aac2bf62be8c tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b358c38b5a44d798f7f53c4b318134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f91ac37f864ed98a03f9082252e334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:02.828522 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-15d1a43a-1040-47e5-8f3e-aac2bf62be8c tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] 10.222.0.55 "GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8" status: 200 len: 1315 microversion: 2.1 time: 0.165212 May 31 21:04:02.829094 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 54/110] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:02 2022] GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:04:03.142573 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-8b65a890-f2e2-4a33-9016-057d291122ee tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:03.143183 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-8b65a890-f2e2-4a33-9016-057d291122ee tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:03.145052 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell0:SELECT=16 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:03.152433 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-8b65a890-f2e2-4a33-9016-057d291122ee tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:03.152866 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-8b65a890-f2e2-4a33-9016-057d291122ee tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:03.153804 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-8b65a890-f2e2-4a33-9016-057d291122ee tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:03.154264 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-8b65a890-f2e2-4a33-9016-057d291122ee tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:03.225851 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-3f19aeba-d65c-409c-bb9a-c26f4fca9e6e tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:03.226830 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-3f19aeba-d65c-409c-bb9a-c26f4fca9e6e tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 9bff085f-5477-4588-9e08-533189d2db08] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:03.232999 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-3f19aeba-d65c-409c-bb9a-c26f4fca9e6e tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:03.233845 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-3f19aeba-d65c-409c-bb9a-c26f4fca9e6e tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:03.234801 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-3f19aeba-d65c-409c-bb9a-c26f4fca9e6e tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:03.235108 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-3f19aeba-d65c-409c-bb9a-c26f4fca9e6e tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:03.321411 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-8b65a890-f2e2-4a33-9016-057d291122ee tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:03.329628 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-8b65a890-f2e2-4a33-9016-057d291122ee tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1363 microversion: 2.1 time: 0.190768 May 31 21:04:03.330327 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 57/111] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:03 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1363 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:04:03.385844 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-3f19aeba-d65c-409c-bb9a-c26f4fca9e6e tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:03.393358 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-3f19aeba-d65c-409c-bb9a-c26f4fca9e6e tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08" status: 200 len: 1321 microversion: 2.1 time: 0.171583 May 31 21:04:03.393944 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 55/112] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:03 2022] GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08 => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:04:03.610831 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-6d597277-5bd9-4695-9f3b-cd93d36c9523 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:03.611691 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-6d597277-5bd9-4695-9f3b-cd93d36c9523 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:03.621036 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-6d597277-5bd9-4695-9f3b-cd93d36c9523 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:03.621843 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-6d597277-5bd9-4695-9f3b-cd93d36c9523 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:03.625389 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-6d597277-5bd9-4695-9f3b-cd93d36c9523 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:03.625389 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-6d597277-5bd9-4695-9f3b-cd93d36c9523 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:03.781164 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-6d597277-5bd9-4695-9f3b-cd93d36c9523 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:03.790868 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-6d597277-5bd9-4695-9f3b-cd93d36c9523 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:03.792688 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-6d597277-5bd9-4695-9f3b-cd93d36c9523 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:03.794013 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-6d597277-5bd9-4695-9f3b-cd93d36c9523 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1406 microversion: 2.20 time: 0.187358 May 31 21:04:03.796829 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 58/113] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:04:03 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1406 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:04:03.845487 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-fa019f19-b7ac-48f8-a844-402bc6b42ed4 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:03.846230 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-fa019f19-b7ac-48f8-a844-402bc6b42ed4 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] [instance: 35c086d9-50bf-494a-90bb-694569f861a8] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:03.852830 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-fa019f19-b7ac-48f8-a844-402bc6b42ed4 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:03.853277 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-fa019f19-b7ac-48f8-a844-402bc6b42ed4 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:03.854144 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-fa019f19-b7ac-48f8-a844-402bc6b42ed4 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:03.854575 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-fa019f19-b7ac-48f8-a844-402bc6b42ed4 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:03.877887 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell0:SELECT=13 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:04.010514 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-fa019f19-b7ac-48f8-a844-402bc6b42ed4 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b358c38b5a44d798f7f53c4b318134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f91ac37f864ed98a03f9082252e334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:04.021750 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-fa019f19-b7ac-48f8-a844-402bc6b42ed4 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] 10.222.0.55 "GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8" status: 200 len: 1315 microversion: 2.1 time: 0.180016 May 31 21:04:04.023025 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 56/114] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:03 2022] GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:04:04.347169 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-c670f74c-2e0c-4e03-87bd-5d186d3a0749 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:04.347813 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-c670f74c-2e0c-4e03-87bd-5d186d3a0749 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:04.354688 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c670f74c-2e0c-4e03-87bd-5d186d3a0749 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:04.354916 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c670f74c-2e0c-4e03-87bd-5d186d3a0749 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:04.355722 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c670f74c-2e0c-4e03-87bd-5d186d3a0749 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:04.356223 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c670f74c-2e0c-4e03-87bd-5d186d3a0749 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:04.410694 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-f2b4d02e-2b8d-481e-8116-97c14898e521 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:04.411293 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-f2b4d02e-2b8d-481e-8116-97c14898e521 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 9bff085f-5477-4588-9e08-533189d2db08] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:04.417989 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f2b4d02e-2b8d-481e-8116-97c14898e521 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:04.418394 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f2b4d02e-2b8d-481e-8116-97c14898e521 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:04.419153 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f2b4d02e-2b8d-481e-8116-97c14898e521 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:04.419634 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f2b4d02e-2b8d-481e-8116-97c14898e521 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:04.527815 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-c670f74c-2e0c-4e03-87bd-5d186d3a0749 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:04.537953 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-c670f74c-2e0c-4e03-87bd-5d186d3a0749 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1363 microversion: 2.1 time: 0.194413 May 31 21:04:04.539011 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 59/115] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:04 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1363 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:04:04.576522 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-f2b4d02e-2b8d-481e-8116-97c14898e521 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:04.584327 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-f2b4d02e-2b8d-481e-8116-97c14898e521 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08" status: 200 len: 1321 microversion: 2.1 time: 0.177597 May 31 21:04:04.585455 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 57/116] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:04 2022] GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08 => generated 1321 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:04:04.816795 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-d0b930e8-8c74-4238-a197-6aa7126dda6c tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:04.817408 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-d0b930e8-8c74-4238-a197-6aa7126dda6c tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:04.824220 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-d0b930e8-8c74-4238-a197-6aa7126dda6c tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:04.824666 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-d0b930e8-8c74-4238-a197-6aa7126dda6c tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:04.825484 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-d0b930e8-8c74-4238-a197-6aa7126dda6c tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:04.825941 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-d0b930e8-8c74-4238-a197-6aa7126dda6c tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:04.967225 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-d0b930e8-8c74-4238-a197-6aa7126dda6c tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:04.986700 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-d0b930e8-8c74-4238-a197-6aa7126dda6c tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:04.988460 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-d0b930e8-8c74-4238-a197-6aa7126dda6c tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:04.990572 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-d0b930e8-8c74-4238-a197-6aa7126dda6c tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1406 microversion: 2.20 time: 0.176827 May 31 21:04:04.990572 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 60/117] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:04:04 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1406 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:04:05.041950 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-0a7da36a-5d09-4da7-b065-3491d555457e tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:05.044929 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-0a7da36a-5d09-4da7-b065-3491d555457e tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] [instance: 35c086d9-50bf-494a-90bb-694569f861a8] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:05.051195 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-0a7da36a-5d09-4da7-b065-3491d555457e tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:05.051715 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-0a7da36a-5d09-4da7-b065-3491d555457e tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:05.052553 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-0a7da36a-5d09-4da7-b065-3491d555457e tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:05.053052 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-0a7da36a-5d09-4da7-b065-3491d555457e tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:05.197502 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-0a7da36a-5d09-4da7-b065-3491d555457e tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b358c38b5a44d798f7f53c4b318134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f91ac37f864ed98a03f9082252e334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:05.204102 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-0a7da36a-5d09-4da7-b065-3491d555457e tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] 10.222.0.55 "GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8" status: 200 len: 1315 microversion: 2.1 time: 0.166284 May 31 21:04:05.204878 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 58/118] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:05 2022] GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:04:05.557020 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-8d532273-3964-4265-8cb4-e3124a13b171 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:05.557814 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-8d532273-3964-4265-8cb4-e3124a13b171 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:05.564181 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-8d532273-3964-4265-8cb4-e3124a13b171 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:05.564631 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-8d532273-3964-4265-8cb4-e3124a13b171 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:05.565400 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-8d532273-3964-4265-8cb4-e3124a13b171 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:05.565838 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-8d532273-3964-4265-8cb4-e3124a13b171 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:05.604051 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-2749fa38-428e-4f85-8032-bab121a12eb4 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:05.604905 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-2749fa38-428e-4f85-8032-bab121a12eb4 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 9bff085f-5477-4588-9e08-533189d2db08] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:05.623960 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2749fa38-428e-4f85-8032-bab121a12eb4 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:05.624418 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2749fa38-428e-4f85-8032-bab121a12eb4 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:05.625233 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2749fa38-428e-4f85-8032-bab121a12eb4 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:05.625743 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2749fa38-428e-4f85-8032-bab121a12eb4 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:05.823809 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-8d532273-3964-4265-8cb4-e3124a13b171 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:05.835574 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-2749fa38-428e-4f85-8032-bab121a12eb4 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:05.835704 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-8d532273-3964-4265-8cb4-e3124a13b171 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1363 microversion: 2.1 time: 0.281070 May 31 21:04:05.835704 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 61/119] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:05 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1363 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:04:05.847887 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-2749fa38-428e-4f85-8032-bab121a12eb4 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08" status: 200 len: 1321 microversion: 2.1 time: 0.249872 May 31 21:04:05.849492 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 59/120] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:05 2022] GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08 => generated 1321 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:04:06.009054 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-bf8e61d3-a855-4aff-85a3-560396f98337 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:06.009666 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-bf8e61d3-a855-4aff-85a3-560396f98337 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:06.018117 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-bf8e61d3-a855-4aff-85a3-560396f98337 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:06.018803 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-bf8e61d3-a855-4aff-85a3-560396f98337 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:06.020262 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-bf8e61d3-a855-4aff-85a3-560396f98337 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:06.020866 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-bf8e61d3-a855-4aff-85a3-560396f98337 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:06.221029 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-609d2e8d-487e-4636-832d-d2b1e78e6caf tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:06.221806 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-609d2e8d-487e-4636-832d-d2b1e78e6caf tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] [instance: 35c086d9-50bf-494a-90bb-694569f861a8] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:06.222018 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-bf8e61d3-a855-4aff-85a3-560396f98337 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:06.228898 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-609d2e8d-487e-4636-832d-d2b1e78e6caf tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:06.229358 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-609d2e8d-487e-4636-832d-d2b1e78e6caf tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:06.230159 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-609d2e8d-487e-4636-832d-d2b1e78e6caf tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:06.230599 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-609d2e8d-487e-4636-832d-d2b1e78e6caf tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:06.231098 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-bf8e61d3-a855-4aff-85a3-560396f98337 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:06.232617 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-bf8e61d3-a855-4aff-85a3-560396f98337 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:06.233727 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-bf8e61d3-a855-4aff-85a3-560396f98337 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1406 microversion: 2.20 time: 0.229433 May 31 21:04:06.234318 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 62/121] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:04:06 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1406 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:04:06.390708 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-609d2e8d-487e-4636-832d-d2b1e78e6caf tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b358c38b5a44d798f7f53c4b318134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f91ac37f864ed98a03f9082252e334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:06.390708 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-609d2e8d-487e-4636-832d-d2b1e78e6caf tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] 10.222.0.55 "GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8" status: 200 len: 1315 microversion: 2.1 time: 0.169736 May 31 21:04:06.390708 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 60/122] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:06 2022] GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:04:06.889511 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-9aa4f235-0c51-4ee8-93bc-c38f76e1a958 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:06.889511 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-9aa4f235-0c51-4ee8-93bc-c38f76e1a958 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:06.889511 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9aa4f235-0c51-4ee8-93bc-c38f76e1a958 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:06.889511 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9aa4f235-0c51-4ee8-93bc-c38f76e1a958 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:06.890157 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9aa4f235-0c51-4ee8-93bc-c38f76e1a958 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:06.890157 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9aa4f235-0c51-4ee8-93bc-c38f76e1a958 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:06.890310 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-ef690646-246d-4cd3-b028-c70148cca9c5 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:06.890310 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-ef690646-246d-4cd3-b028-c70148cca9c5 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 9bff085f-5477-4588-9e08-533189d2db08] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:06.890310 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ef690646-246d-4cd3-b028-c70148cca9c5 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:06.890310 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ef690646-246d-4cd3-b028-c70148cca9c5 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:06.890595 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ef690646-246d-4cd3-b028-c70148cca9c5 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:06.890595 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ef690646-246d-4cd3-b028-c70148cca9c5 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:07.055804 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-9aa4f235-0c51-4ee8-93bc-c38f76e1a958 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:07.063479 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-9aa4f235-0c51-4ee8-93bc-c38f76e1a958 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1363 microversion: 2.1 time: 0.215959 May 31 21:04:07.064057 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 63/123] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:06 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1363 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:04:07.067247 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-ef690646-246d-4cd3-b028-c70148cca9c5 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:07.075447 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-ef690646-246d-4cd3-b028-c70148cca9c5 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08" status: 200 len: 1321 microversion: 2.1 time: 0.211551 May 31 21:04:07.076012 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 61/124] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:06 2022] GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08 => generated 1321 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:04:07.252791 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-07eeab65-5afe-4cec-8e97-06d2c79c64a6 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:07.253401 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-07eeab65-5afe-4cec-8e97-06d2c79c64a6 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:07.259522 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-07eeab65-5afe-4cec-8e97-06d2c79c64a6 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:07.259971 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-07eeab65-5afe-4cec-8e97-06d2c79c64a6 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:07.260740 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-07eeab65-5afe-4cec-8e97-06d2c79c64a6 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:07.261175 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-07eeab65-5afe-4cec-8e97-06d2c79c64a6 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:07.407695 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-455535aa-6c8a-462c-87ec-ee3fa12581a0 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:07.408163 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-455535aa-6c8a-462c-87ec-ee3fa12581a0 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] [instance: 35c086d9-50bf-494a-90bb-694569f861a8] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:07.411249 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-07eeab65-5afe-4cec-8e97-06d2c79c64a6 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:07.417376 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-455535aa-6c8a-462c-87ec-ee3fa12581a0 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:07.418525 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-455535aa-6c8a-462c-87ec-ee3fa12581a0 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:07.419586 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-455535aa-6c8a-462c-87ec-ee3fa12581a0 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:07.420509 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-455535aa-6c8a-462c-87ec-ee3fa12581a0 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:07.431556 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-07eeab65-5afe-4cec-8e97-06d2c79c64a6 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:07.433237 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-07eeab65-5afe-4cec-8e97-06d2c79c64a6 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:07.434421 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-07eeab65-5afe-4cec-8e97-06d2c79c64a6 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1406 microversion: 2.20 time: 0.185629 May 31 21:04:07.435127 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 64/125] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:04:07 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1406 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:04:07.571491 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-455535aa-6c8a-462c-87ec-ee3fa12581a0 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b358c38b5a44d798f7f53c4b318134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f91ac37f864ed98a03f9082252e334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:07.580470 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-455535aa-6c8a-462c-87ec-ee3fa12581a0 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] 10.222.0.55 "GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8" status: 200 len: 1315 microversion: 2.1 time: 0.176722 May 31 21:04:07.581065 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 62/126] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:07 2022] GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:04:08.081064 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-94ec6b1e-9764-4c4d-80fc-d4b14aee0b14 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:08.081603 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-94ec6b1e-9764-4c4d-80fc-d4b14aee0b14 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:08.088363 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-94ec6b1e-9764-4c4d-80fc-d4b14aee0b14 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:08.088822 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-94ec6b1e-9764-4c4d-80fc-d4b14aee0b14 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:08.089597 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-94ec6b1e-9764-4c4d-80fc-d4b14aee0b14 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:08.090076 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-94ec6b1e-9764-4c4d-80fc-d4b14aee0b14 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:08.093042 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-5860875e-5087-4a06-8cba-d4a2d0b6582c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:08.093656 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-5860875e-5087-4a06-8cba-d4a2d0b6582c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 9bff085f-5477-4588-9e08-533189d2db08] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:08.099839 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5860875e-5087-4a06-8cba-d4a2d0b6582c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:08.100873 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5860875e-5087-4a06-8cba-d4a2d0b6582c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:08.101679 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5860875e-5087-4a06-8cba-d4a2d0b6582c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:08.102139 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5860875e-5087-4a06-8cba-d4a2d0b6582c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:08.299744 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-94ec6b1e-9764-4c4d-80fc-d4b14aee0b14 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:08.307095 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-5860875e-5087-4a06-8cba-d4a2d0b6582c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:08.315800 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-5860875e-5087-4a06-8cba-d4a2d0b6582c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08" status: 200 len: 1321 microversion: 2.1 time: 0.226475 May 31 21:04:08.316385 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 63/127] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:08 2022] GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08 => generated 1321 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:04:08.325424 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-94ec6b1e-9764-4c4d-80fc-d4b14aee0b14 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1363 microversion: 2.1 time: 0.237077 May 31 21:04:08.325424 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 65/128] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:08 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1363 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:04:08.454294 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-948e4bd6-bb4f-4fee-bf65-71c674fb1b0c tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:08.455003 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-948e4bd6-bb4f-4fee-bf65-71c674fb1b0c tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:08.461096 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-948e4bd6-bb4f-4fee-bf65-71c674fb1b0c tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:08.461544 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-948e4bd6-bb4f-4fee-bf65-71c674fb1b0c tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:08.462340 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-948e4bd6-bb4f-4fee-bf65-71c674fb1b0c tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:08.462779 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-948e4bd6-bb4f-4fee-bf65-71c674fb1b0c tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:08.598500 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-5f8cf479-19b3-4a59-bdbf-6da14004393f tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:08.598969 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-948e4bd6-bb4f-4fee-bf65-71c674fb1b0c tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:08.599172 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-5f8cf479-19b3-4a59-bdbf-6da14004393f tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] [instance: 35c086d9-50bf-494a-90bb-694569f861a8] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:08.601621 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell0:SELECT=8 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:08.606783 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5f8cf479-19b3-4a59-bdbf-6da14004393f tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:08.607462 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5f8cf479-19b3-4a59-bdbf-6da14004393f tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:08.608180 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-948e4bd6-bb4f-4fee-bf65-71c674fb1b0c tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:08.608339 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5f8cf479-19b3-4a59-bdbf-6da14004393f tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:08.608653 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5f8cf479-19b3-4a59-bdbf-6da14004393f tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:08.609793 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-948e4bd6-bb4f-4fee-bf65-71c674fb1b0c tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:08.610961 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-948e4bd6-bb4f-4fee-bf65-71c674fb1b0c tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1406 microversion: 2.20 time: 0.160981 May 31 21:04:08.611528 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 66/129] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:04:08 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:04:08.761565 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-5f8cf479-19b3-4a59-bdbf-6da14004393f tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b358c38b5a44d798f7f53c4b318134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f91ac37f864ed98a03f9082252e334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:08.769879 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-5f8cf479-19b3-4a59-bdbf-6da14004393f tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] 10.222.0.55 "GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8" status: 200 len: 1315 microversion: 2.1 time: 0.175193 May 31 21:04:08.770838 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 64/130] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:08 2022] GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:04:09.334627 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-48386c9c-068d-48cf-a4bf-7d19bc1e246c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:09.335728 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-6461c0e5-e696-4b0d-beeb-87341c658d20 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:09.336510 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-6461c0e5-e696-4b0d-beeb-87341c658d20 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:09.337155 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-48386c9c-068d-48cf-a4bf-7d19bc1e246c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 9bff085f-5477-4588-9e08-533189d2db08] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:09.345241 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6461c0e5-e696-4b0d-beeb-87341c658d20 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:09.345703 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6461c0e5-e696-4b0d-beeb-87341c658d20 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:09.346391 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-48386c9c-068d-48cf-a4bf-7d19bc1e246c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:09.347033 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6461c0e5-e696-4b0d-beeb-87341c658d20 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:09.347543 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-48386c9c-068d-48cf-a4bf-7d19bc1e246c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:09.347701 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6461c0e5-e696-4b0d-beeb-87341c658d20 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:09.348497 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-48386c9c-068d-48cf-a4bf-7d19bc1e246c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:09.348936 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-48386c9c-068d-48cf-a4bf-7d19bc1e246c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:09.569931 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-6461c0e5-e696-4b0d-beeb-87341c658d20 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:09.572729 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-48386c9c-068d-48cf-a4bf-7d19bc1e246c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:09.581398 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-6461c0e5-e696-4b0d-beeb-87341c658d20 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1363 microversion: 2.1 time: 0.250454 May 31 21:04:09.581638 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-48386c9c-068d-48cf-a4bf-7d19bc1e246c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08" status: 200 len: 1321 microversion: 2.1 time: 0.251546 May 31 21:04:09.582021 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 67/131] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:09 2022] GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08 => generated 1321 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:04:09.582592 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 65/132] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:09 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1363 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:04:09.633829 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-625fd1a6-e0b0-4bdb-9793-ebea6dce0337 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:09.633829 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-625fd1a6-e0b0-4bdb-9793-ebea6dce0337 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:09.637545 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-625fd1a6-e0b0-4bdb-9793-ebea6dce0337 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:09.638023 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-625fd1a6-e0b0-4bdb-9793-ebea6dce0337 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:09.638815 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-625fd1a6-e0b0-4bdb-9793-ebea6dce0337 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:09.639259 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-625fd1a6-e0b0-4bdb-9793-ebea6dce0337 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:09.787449 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-82edfff0-0bff-4b63-86a4-0b6a53dd157b tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:09.795080 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-82edfff0-0bff-4b63-86a4-0b6a53dd157b tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] [instance: 35c086d9-50bf-494a-90bb-694569f861a8] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:09.796361 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-82edfff0-0bff-4b63-86a4-0b6a53dd157b tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:09.797027 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-82edfff0-0bff-4b63-86a4-0b6a53dd157b tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:09.798075 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-82edfff0-0bff-4b63-86a4-0b6a53dd157b tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:09.798816 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-82edfff0-0bff-4b63-86a4-0b6a53dd157b tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:09.919903 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-625fd1a6-e0b0-4bdb-9793-ebea6dce0337 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:09.938849 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-625fd1a6-e0b0-4bdb-9793-ebea6dce0337 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:09.940976 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-625fd1a6-e0b0-4bdb-9793-ebea6dce0337 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:09.942204 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-625fd1a6-e0b0-4bdb-9793-ebea6dce0337 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1406 microversion: 2.20 time: 0.316949 May 31 21:04:09.943324 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 68/133] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:04:09 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1406 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:04:10.105441 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-82edfff0-0bff-4b63-86a4-0b6a53dd157b tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b358c38b5a44d798f7f53c4b318134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f91ac37f864ed98a03f9082252e334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:10.116631 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-82edfff0-0bff-4b63-86a4-0b6a53dd157b tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] 10.222.0.55 "GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8" status: 200 len: 1315 microversion: 2.1 time: 0.332318 May 31 21:04:10.121635 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 66/134] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:09 2022] GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8 => generated 1315 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:04:10.604789 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-e3c3e6f6-db88-4f02-9995-ee2bf86d774a tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:10.605424 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-e3c3e6f6-db88-4f02-9995-ee2bf86d774a tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 9bff085f-5477-4588-9e08-533189d2db08] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:10.609586 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-5524b23c-5a14-41e3-8909-ad26c8b65ae7 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:10.610987 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-5524b23c-5a14-41e3-8909-ad26c8b65ae7 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:10.639540 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e3c3e6f6-db88-4f02-9995-ee2bf86d774a tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:10.640802 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5524b23c-5a14-41e3-8909-ad26c8b65ae7 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:10.641274 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5524b23c-5a14-41e3-8909-ad26c8b65ae7 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:10.642133 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5524b23c-5a14-41e3-8909-ad26c8b65ae7 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:10.642580 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5524b23c-5a14-41e3-8909-ad26c8b65ae7 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:10.645266 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e3c3e6f6-db88-4f02-9995-ee2bf86d774a tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:10.645266 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e3c3e6f6-db88-4f02-9995-ee2bf86d774a tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:10.645266 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e3c3e6f6-db88-4f02-9995-ee2bf86d774a tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:11.134471 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-e3c3e6f6-db88-4f02-9995-ee2bf86d774a tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:11.147232 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-e3c3e6f6-db88-4f02-9995-ee2bf86d774a tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08" status: 200 len: 1321 microversion: 2.1 time: 0.550705 May 31 21:04:11.165623 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 69/135] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:10 2022] GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08 => generated 1321 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:04:11.173076 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [req-3fad5c58-ea79-4ff5-96f8-a3787f3259a4 req-fdb80c7d-d2dc-4f5b-a8ae-433a1ca2c364 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "faf12fce-2352-40df-a297-0d7b28379014", "tag": "eb53f5b6-46bd-4009-8d09-18c62dd763ce"}]} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:04:11.174193 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-5524b23c-5a14-41e3-8909-ad26c8b65ae7 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:11.185117 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-5524b23c-5a14-41e3-8909-ad26c8b65ae7 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1363 microversion: 2.1 time: 0.586660 May 31 21:04:11.186342 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 67/136] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:10 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1363 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:04:11.189694 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-3fad5c58-ea79-4ff5-96f8-a3787f3259a4 req-fdb80c7d-d2dc-4f5b-a8ae-433a1ca2c364 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:11.190931 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-3fad5c58-ea79-4ff5-96f8-a3787f3259a4 req-fdb80c7d-d2dc-4f5b-a8ae-433a1ca2c364 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:11.195907 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [req-afe41210-9214-4e69-8dcd-9e6e086dc7b1 req-8d66f4b3-bca1-4762-aba7-141e92e83758 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24059932-87a0-4e56-8bb0-4797276e2042", "name": "network-vif-plugged", "status": "completed", "tag": "d441d5e6-2812-4d1f-bf38-96cb2c781ded"}]} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:04:11.213482 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:11.217622 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-afe41210-9214-4e69-8dcd-9e6e086dc7b1 req-8d66f4b3-bca1-4762-aba7-141e92e83758 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:11.218487 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-afe41210-9214-4e69-8dcd-9e6e086dc7b1 req-8d66f4b3-bca1-4762-aba7-141e92e83758 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:11.220440 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.compute.server_external_events [req-3fad5c58-ea79-4ff5-96f8-a3787f3259a4 req-fdb80c7d-d2dc-4f5b-a8ae-433a1ca2c364 service nova] Creating event network-changed:eb53f5b6-46bd-4009-8d09-18c62dd763ce for instance faf12fce-2352-40df-a297-0d7b28379014 on hv-cinder-83979 May 31 21:04:11.223561 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell1:SELECT=100 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:11.226545 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [req-3fad5c58-ea79-4ff5-96f8-a3787f3259a4 req-fdb80c7d-d2dc-4f5b-a8ae-433a1ca2c364 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058671 May 31 21:04:11.227837 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 70/137] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:04:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:04:11.233364 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.compute.server_external_events [req-afe41210-9214-4e69-8dcd-9e6e086dc7b1 req-8d66f4b3-bca1-4762-aba7-141e92e83758 service nova] Creating event network-vif-plugged:d441d5e6-2812-4d1f-bf38-96cb2c781ded for instance 24059932-87a0-4e56-8bb0-4797276e2042 on hv-cinder-83979 May 31 21:04:11.234154 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-5a51d9bb-c3ad-4862-b15c-900c29777834 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:11.234896 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-5a51d9bb-c3ad-4862-b15c-900c29777834 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:11.237183 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:11.240484 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [req-afe41210-9214-4e69-8dcd-9e6e086dc7b1 req-8d66f4b3-bca1-4762-aba7-141e92e83758 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052690 May 31 21:04:11.244538 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 68/138] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:04:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:04:11.247836 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-57476f09-acb3-407d-a3c0-7353df000ce9 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:11.248588 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-57476f09-acb3-407d-a3c0-7353df000ce9 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] [instance: 35c086d9-50bf-494a-90bb-694569f861a8] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:11.253065 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-5a51d9bb-c3ad-4862-b15c-900c29777834 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:11.253862 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-5a51d9bb-c3ad-4862-b15c-900c29777834 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:11.255318 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-5a51d9bb-c3ad-4862-b15c-900c29777834 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:11.255681 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-57476f09-acb3-407d-a3c0-7353df000ce9 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:11.256123 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-5a51d9bb-c3ad-4862-b15c-900c29777834 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:11.256229 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-57476f09-acb3-407d-a3c0-7353df000ce9 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:11.257812 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-57476f09-acb3-407d-a3c0-7353df000ce9 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:11.258386 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-57476f09-acb3-407d-a3c0-7353df000ce9 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:11.572390 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-5a51d9bb-c3ad-4862-b15c-900c29777834 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:11.574021 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-57476f09-acb3-407d-a3c0-7353df000ce9 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b358c38b5a44d798f7f53c4b318134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f91ac37f864ed98a03f9082252e334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:11.583532 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-57476f09-acb3-407d-a3c0-7353df000ce9 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] 10.222.0.55 "GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8" status: 200 len: 1315 microversion: 2.1 time: 0.340672 May 31 21:04:11.584688 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 69/139] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:11 2022] GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8 => generated 1315 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:04:11.598128 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-5a51d9bb-c3ad-4862-b15c-900c29777834 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:11.599757 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-5a51d9bb-c3ad-4862-b15c-900c29777834 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:11.601267 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-5a51d9bb-c3ad-4862-b15c-900c29777834 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1406 microversion: 2.20 time: 0.372309 May 31 21:04:11.604508 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 71/140] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:04:11 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1406 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:04:12.180224 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-d5f71d23-cce8-49cc-865c-0479d3cf6b8f tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:12.182267 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-d5f71d23-cce8-49cc-865c-0479d3cf6b8f tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 9bff085f-5477-4588-9e08-533189d2db08] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:12.190773 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d5f71d23-cce8-49cc-865c-0479d3cf6b8f tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:12.191771 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d5f71d23-cce8-49cc-865c-0479d3cf6b8f tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:12.192909 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d5f71d23-cce8-49cc-865c-0479d3cf6b8f tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:12.193195 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d5f71d23-cce8-49cc-865c-0479d3cf6b8f tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:12.203106 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-35c8cc9c-f367-4ff5-b0e3-6af150cdd4e8 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:12.204031 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-35c8cc9c-f367-4ff5-b0e3-6af150cdd4e8 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:12.214782 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-35c8cc9c-f367-4ff5-b0e3-6af150cdd4e8 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:12.215271 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-35c8cc9c-f367-4ff5-b0e3-6af150cdd4e8 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:12.216173 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-35c8cc9c-f367-4ff5-b0e3-6af150cdd4e8 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:12.216655 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-35c8cc9c-f367-4ff5-b0e3-6af150cdd4e8 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:12.426283 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-d5f71d23-cce8-49cc-865c-0479d3cf6b8f tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:12.430432 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-35c8cc9c-f367-4ff5-b0e3-6af150cdd4e8 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:12.433760 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-d5f71d23-cce8-49cc-865c-0479d3cf6b8f tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08" status: 200 len: 1321 microversion: 2.1 time: 0.263531 May 31 21:04:12.434374 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 70/141] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:12 2022] GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08 => generated 1321 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:04:12.443065 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-35c8cc9c-f367-4ff5-b0e3-6af150cdd4e8 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1363 microversion: 2.1 time: 0.243714 May 31 21:04:12.443705 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 72/142] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:12 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1363 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:04:12.601147 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-1af2f67e-fece-47f2-ae0b-2601f54c301f tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:12.601736 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-1af2f67e-fece-47f2-ae0b-2601f54c301f tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] [instance: 35c086d9-50bf-494a-90bb-694569f861a8] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:12.609540 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-1af2f67e-fece-47f2-ae0b-2601f54c301f tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:12.610470 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-1af2f67e-fece-47f2-ae0b-2601f54c301f tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:12.611257 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-1af2f67e-fece-47f2-ae0b-2601f54c301f tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:12.611978 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-1af2f67e-fece-47f2-ae0b-2601f54c301f tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:12.621422 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-e23e4f0f-2fbd-4d52-83e0-3e320f2fbf10 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:12.622051 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-e23e4f0f-2fbd-4d52-83e0-3e320f2fbf10 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:12.628105 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e23e4f0f-2fbd-4d52-83e0-3e320f2fbf10 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:12.628828 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e23e4f0f-2fbd-4d52-83e0-3e320f2fbf10 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:12.629812 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e23e4f0f-2fbd-4d52-83e0-3e320f2fbf10 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:12.630474 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e23e4f0f-2fbd-4d52-83e0-3e320f2fbf10 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:12.843465 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-1af2f67e-fece-47f2-ae0b-2601f54c301f tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b358c38b5a44d798f7f53c4b318134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f91ac37f864ed98a03f9082252e334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:12.853073 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-1af2f67e-fece-47f2-ae0b-2601f54c301f tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] 10.222.0.55 "GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8" status: 200 len: 1502 microversion: 2.1 time: 0.256311 May 31 21:04:12.865762 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-e23e4f0f-2fbd-4d52-83e0-3e320f2fbf10 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:12.867007 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 71/143] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:12 2022] GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8 => generated 1502 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:04:12.881154 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-e23e4f0f-2fbd-4d52-83e0-3e320f2fbf10 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:12.883529 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-e23e4f0f-2fbd-4d52-83e0-3e320f2fbf10 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:12.884645 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-e23e4f0f-2fbd-4d52-83e0-3e320f2fbf10 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1406 microversion: 2.20 time: 0.267149 May 31 21:04:12.885778 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 73/144] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:04:12 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1406 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:04:13.450937 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-4589246d-3d00-499e-bc9a-ca92938a21d8 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:13.451458 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-4589246d-3d00-499e-bc9a-ca92938a21d8 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 9bff085f-5477-4588-9e08-533189d2db08] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:13.460790 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-4b882fdb-d720-4cff-b03d-e120fe796265 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:13.461410 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-4b882fdb-d720-4cff-b03d-e120fe796265 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:13.470923 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4b882fdb-d720-4cff-b03d-e120fe796265 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:13.471383 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4b882fdb-d720-4cff-b03d-e120fe796265 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:13.474282 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4589246d-3d00-499e-bc9a-ca92938a21d8 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:13.474921 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4589246d-3d00-499e-bc9a-ca92938a21d8 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:13.476581 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4589246d-3d00-499e-bc9a-ca92938a21d8 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:13.477024 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4589246d-3d00-499e-bc9a-ca92938a21d8 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:13.481351 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4b882fdb-d720-4cff-b03d-e120fe796265 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:13.482024 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4b882fdb-d720-4cff-b03d-e120fe796265 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:13.487484 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell1:SELECT=100 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:13.731884 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-4589246d-3d00-499e-bc9a-ca92938a21d8 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:13.752398 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-4589246d-3d00-499e-bc9a-ca92938a21d8 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08" status: 200 len: 1321 microversion: 2.1 time: 0.304343 May 31 21:04:13.753544 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 72/145] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:13 2022] GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08 => generated 1321 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:04:13.776325 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-4b882fdb-d720-4cff-b03d-e120fe796265 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:13.785553 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-4b882fdb-d720-4cff-b03d-e120fe796265 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1363 microversion: 2.1 time: 0.329200 May 31 21:04:13.788466 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 74/146] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:13 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1363 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:04:13.907391 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-578559d5-f04b-4068-b7ca-6f1f52458f1b tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:13.908378 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-578559d5-f04b-4068-b7ca-6f1f52458f1b tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:13.917638 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-578559d5-f04b-4068-b7ca-6f1f52458f1b tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:13.919767 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-578559d5-f04b-4068-b7ca-6f1f52458f1b tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:13.919767 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-578559d5-f04b-4068-b7ca-6f1f52458f1b tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:13.920375 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-578559d5-f04b-4068-b7ca-6f1f52458f1b tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:14.064289 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-578559d5-f04b-4068-b7ca-6f1f52458f1b tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:14.072692 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-578559d5-f04b-4068-b7ca-6f1f52458f1b tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:14.074220 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-578559d5-f04b-4068-b7ca-6f1f52458f1b tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:14.075342 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-578559d5-f04b-4068-b7ca-6f1f52458f1b tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1406 microversion: 2.20 time: 0.174615 May 31 21:04:14.075906 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 73/147] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:04:13 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:04:14.775810 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-713907e7-9c07-44c0-bc27-70fe7a97ff58 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:14.776896 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-713907e7-9c07-44c0-bc27-70fe7a97ff58 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 9bff085f-5477-4588-9e08-533189d2db08] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:14.790874 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-713907e7-9c07-44c0-bc27-70fe7a97ff58 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:14.792108 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-713907e7-9c07-44c0-bc27-70fe7a97ff58 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:14.793812 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-713907e7-9c07-44c0-bc27-70fe7a97ff58 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:14.801516 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-713907e7-9c07-44c0-bc27-70fe7a97ff58 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:14.810878 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-73912af7-3975-404e-9c7d-e861b09749a8 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:14.812079 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-73912af7-3975-404e-9c7d-e861b09749a8 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:14.820547 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-73912af7-3975-404e-9c7d-e861b09749a8 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:14.821012 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-73912af7-3975-404e-9c7d-e861b09749a8 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:14.821827 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-73912af7-3975-404e-9c7d-e861b09749a8 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:14.822321 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-73912af7-3975-404e-9c7d-e861b09749a8 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:15.096038 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-713907e7-9c07-44c0-bc27-70fe7a97ff58 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:15.099352 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-73912af7-3975-404e-9c7d-e861b09749a8 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:15.110963 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-713907e7-9c07-44c0-bc27-70fe7a97ff58 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08" status: 200 len: 1321 microversion: 2.1 time: 0.341506 May 31 21:04:15.112426 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 75/148] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:14 2022] GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08 => generated 1321 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:04:15.112592 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-73912af7-3975-404e-9c7d-e861b09749a8 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1363 microversion: 2.1 time: 0.309297 May 31 21:04:15.125999 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 74/149] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:14 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1363 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:04:15.137342 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-db94f848-253d-4ef7-a733-1f09aab7c084 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:15.145005 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-db94f848-253d-4ef7-a733-1f09aab7c084 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:15.149751 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-db94f848-253d-4ef7-a733-1f09aab7c084 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:15.150329 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-db94f848-253d-4ef7-a733-1f09aab7c084 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:15.151108 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-db94f848-253d-4ef7-a733-1f09aab7c084 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:15.151639 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-db94f848-253d-4ef7-a733-1f09aab7c084 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:15.321403 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-db94f848-253d-4ef7-a733-1f09aab7c084 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:15.330830 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-db94f848-253d-4ef7-a733-1f09aab7c084 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:15.332516 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-db94f848-253d-4ef7-a733-1f09aab7c084 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:15.333756 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-db94f848-253d-4ef7-a733-1f09aab7c084 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1406 microversion: 2.20 time: 0.204258 May 31 21:04:15.334432 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 76/150] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:04:15 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1406 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:04:16.135698 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-4d735ed9-9244-4f8b-9b72-82087adc3a6c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:16.136420 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-4d735ed9-9244-4f8b-9b72-82087adc3a6c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 9bff085f-5477-4588-9e08-533189d2db08] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:16.139038 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-86bb4e6b-af86-4bcf-8fff-04260a11d163 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:16.139943 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-86bb4e6b-af86-4bcf-8fff-04260a11d163 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:16.143715 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4d735ed9-9244-4f8b-9b72-82087adc3a6c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:16.144474 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4d735ed9-9244-4f8b-9b72-82087adc3a6c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:16.145504 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4d735ed9-9244-4f8b-9b72-82087adc3a6c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:16.146064 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4d735ed9-9244-4f8b-9b72-82087adc3a6c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:16.146864 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-86bb4e6b-af86-4bcf-8fff-04260a11d163 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:16.147318 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-86bb4e6b-af86-4bcf-8fff-04260a11d163 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:16.148338 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-86bb4e6b-af86-4bcf-8fff-04260a11d163 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:16.148793 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-86bb4e6b-af86-4bcf-8fff-04260a11d163 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:16.563196 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-86bb4e6b-af86-4bcf-8fff-04260a11d163 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:16.567060 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-4d735ed9-9244-4f8b-9b72-82087adc3a6c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:16.570886 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-86bb4e6b-af86-4bcf-8fff-04260a11d163 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1363 microversion: 2.1 time: 0.435896 May 31 21:04:16.571471 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 77/151] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:16 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1363 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:04:16.575160 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-4d735ed9-9244-4f8b-9b72-82087adc3a6c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08" status: 200 len: 1321 microversion: 2.1 time: 0.444249 May 31 21:04:16.576035 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 75/152] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:16 2022] GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08 => generated 1321 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:04:16.576159 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-364f775f-d287-4c1a-8321-4d38bd0bb9fb tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:16.576852 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-364f775f-d287-4c1a-8321-4d38bd0bb9fb tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:16.584092 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-364f775f-d287-4c1a-8321-4d38bd0bb9fb tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:16.584545 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-364f775f-d287-4c1a-8321-4d38bd0bb9fb tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:16.585342 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-364f775f-d287-4c1a-8321-4d38bd0bb9fb tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:16.585781 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-364f775f-d287-4c1a-8321-4d38bd0bb9fb tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:16.723144 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-364f775f-d287-4c1a-8321-4d38bd0bb9fb tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:16.732388 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-364f775f-d287-4c1a-8321-4d38bd0bb9fb tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:16.733887 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-364f775f-d287-4c1a-8321-4d38bd0bb9fb tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:16.735009 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-364f775f-d287-4c1a-8321-4d38bd0bb9fb tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1406 microversion: 2.20 time: 0.162623 May 31 21:04:16.735563 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 78/153] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:04:16 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:04:17.590843 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-41060e61-0656-45ef-a8bb-b2d42fb17f19 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:17.592141 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-41060e61-0656-45ef-a8bb-b2d42fb17f19 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:17.592256 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-dda2c054-1c5f-45c4-8db9-015b45469d6f tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:17.593002 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-dda2c054-1c5f-45c4-8db9-015b45469d6f tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 9bff085f-5477-4588-9e08-533189d2db08] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:17.599821 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-41060e61-0656-45ef-a8bb-b2d42fb17f19 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:17.600067 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-dda2c054-1c5f-45c4-8db9-015b45469d6f tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:17.600674 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-41060e61-0656-45ef-a8bb-b2d42fb17f19 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:17.601181 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-dda2c054-1c5f-45c4-8db9-015b45469d6f tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:17.601592 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-41060e61-0656-45ef-a8bb-b2d42fb17f19 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:17.601994 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-dda2c054-1c5f-45c4-8db9-015b45469d6f tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:17.602121 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-41060e61-0656-45ef-a8bb-b2d42fb17f19 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:17.602820 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-dda2c054-1c5f-45c4-8db9-015b45469d6f tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:17.824528 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-41060e61-0656-45ef-a8bb-b2d42fb17f19 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:17.830455 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-dda2c054-1c5f-45c4-8db9-015b45469d6f tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:17.836174 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-41060e61-0656-45ef-a8bb-b2d42fb17f19 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1363 microversion: 2.1 time: 0.249530 May 31 21:04:17.838369 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 76/154] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:17 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1363 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:04:17.844276 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-dda2c054-1c5f-45c4-8db9-015b45469d6f tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08" status: 200 len: 1321 microversion: 2.1 time: 0.255838 May 31 21:04:17.854281 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 79/155] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:17 2022] GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08 => generated 1321 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:04:17.855532 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-23f48e29-9779-4f80-ab87-2480314f39a0 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:17.856500 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-23f48e29-9779-4f80-ab87-2480314f39a0 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:17.863168 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-23f48e29-9779-4f80-ab87-2480314f39a0 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:17.863616 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-23f48e29-9779-4f80-ab87-2480314f39a0 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:17.864480 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-23f48e29-9779-4f80-ab87-2480314f39a0 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:17.872377 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-23f48e29-9779-4f80-ab87-2480314f39a0 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:17.925004 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-f0d50462-ee3f-4daf-a860-1538a81353ac tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a1716438-d4af-402f-8c03-f4d085edc38a"}} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:04:17.926340 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-f0d50462-ee3f-4daf-a860-1538a81353ac tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] [instance: 35c086d9-50bf-494a-90bb-694569f861a8] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:17.933349 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f0d50462-ee3f-4daf-a860-1538a81353ac tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:17.938922 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f0d50462-ee3f-4daf-a860-1538a81353ac tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:17.938922 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f0d50462-ee3f-4daf-a860-1538a81353ac tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:17.938922 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f0d50462-ee3f-4daf-a860-1538a81353ac tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:18.041439 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-23f48e29-9779-4f80-ab87-2480314f39a0 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:18.051345 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-23f48e29-9779-4f80-ab87-2480314f39a0 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:18.052904 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-23f48e29-9779-4f80-ab87-2480314f39a0 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:18.054839 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-23f48e29-9779-4f80-ab87-2480314f39a0 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1406 microversion: 2.20 time: 0.215138 May 31 21:04:18.055403 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 77/156] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:04:17 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1406 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:04:18.859478 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-d2f0a17a-c26e-4ecd-bb52-f1ed89e62488 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:18.860774 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-d2f0a17a-c26e-4ecd-bb52-f1ed89e62488 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:18.870575 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d2f0a17a-c26e-4ecd-bb52-f1ed89e62488 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:18.871321 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d2f0a17a-c26e-4ecd-bb52-f1ed89e62488 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:18.872670 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d2f0a17a-c26e-4ecd-bb52-f1ed89e62488 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:18.873452 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d2f0a17a-c26e-4ecd-bb52-f1ed89e62488 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:19.036445 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-d2f0a17a-c26e-4ecd-bb52-f1ed89e62488 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:19.040096 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-d2f0a17a-c26e-4ecd-bb52-f1ed89e62488 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1363 microversion: 2.1 time: 0.186357 May 31 21:04:19.040629 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 78/157] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:18 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:04:19.045001 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-6a4282cf-76b8-4a30-858a-6b67b71a9cc7 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:19.045669 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-6a4282cf-76b8-4a30-858a-6b67b71a9cc7 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 9bff085f-5477-4588-9e08-533189d2db08] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:19.051546 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6a4282cf-76b8-4a30-858a-6b67b71a9cc7 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:19.051995 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6a4282cf-76b8-4a30-858a-6b67b71a9cc7 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:19.052804 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6a4282cf-76b8-4a30-858a-6b67b71a9cc7 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:19.053232 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6a4282cf-76b8-4a30-858a-6b67b71a9cc7 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:19.215524 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-6a4282cf-76b8-4a30-858a-6b67b71a9cc7 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:19.228403 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-6a4282cf-76b8-4a30-858a-6b67b71a9cc7 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08" status: 200 len: 1321 microversion: 2.1 time: 0.186445 May 31 21:04:19.229420 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 79/158] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:19 2022] GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08 => generated 1321 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:04:19.238406 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-f94d8fd4-0a13-4ecf-a263-41fc215f5199 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:19.239441 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-f94d8fd4-0a13-4ecf-a263-41fc215f5199 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:19.249314 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f94d8fd4-0a13-4ecf-a263-41fc215f5199 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:19.249978 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f94d8fd4-0a13-4ecf-a263-41fc215f5199 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:19.250906 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f94d8fd4-0a13-4ecf-a263-41fc215f5199 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:19.251445 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f94d8fd4-0a13-4ecf-a263-41fc215f5199 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:19.420263 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-f94d8fd4-0a13-4ecf-a263-41fc215f5199 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:19.433981 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-f94d8fd4-0a13-4ecf-a263-41fc215f5199 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:19.437208 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-f94d8fd4-0a13-4ecf-a263-41fc215f5199 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:19.439286 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-f94d8fd4-0a13-4ecf-a263-41fc215f5199 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1406 microversion: 2.20 time: 0.208131 May 31 21:04:19.439775 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 80/159] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:04:19 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1406 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:04:20.056662 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-39aff1b8-b887-4770-b9b8-8c4530538cb8 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:20.057328 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-39aff1b8-b887-4770-b9b8-8c4530538cb8 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:20.063457 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-39aff1b8-b887-4770-b9b8-8c4530538cb8 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:20.063965 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-39aff1b8-b887-4770-b9b8-8c4530538cb8 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:20.064746 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-39aff1b8-b887-4770-b9b8-8c4530538cb8 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:20.065212 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-39aff1b8-b887-4770-b9b8-8c4530538cb8 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:20.204290 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-39aff1b8-b887-4770-b9b8-8c4530538cb8 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:20.213836 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-39aff1b8-b887-4770-b9b8-8c4530538cb8 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1363 microversion: 2.1 time: 0.161068 May 31 21:04:20.214482 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 81/160] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:20 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:04:20.248335 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-170350f8-374d-401d-9654-9517b6c7c59a tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:20.248846 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-170350f8-374d-401d-9654-9517b6c7c59a tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 9bff085f-5477-4588-9e08-533189d2db08] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:20.255275 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-170350f8-374d-401d-9654-9517b6c7c59a tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:20.255725 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-170350f8-374d-401d-9654-9517b6c7c59a tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:20.256498 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-170350f8-374d-401d-9654-9517b6c7c59a tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:20.257483 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-170350f8-374d-401d-9654-9517b6c7c59a tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:20.405336 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-170350f8-374d-401d-9654-9517b6c7c59a tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:20.413753 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-170350f8-374d-401d-9654-9517b6c7c59a tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08" status: 200 len: 1321 microversion: 2.1 time: 0.168912 May 31 21:04:20.414484 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 82/161] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:20 2022] GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08 => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:04:20.457387 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-4c5b0527-3427-4a76-832f-9f7d90697fda tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:20.458045 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-4c5b0527-3427-4a76-832f-9f7d90697fda tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:20.464217 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4c5b0527-3427-4a76-832f-9f7d90697fda tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:20.464812 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4c5b0527-3427-4a76-832f-9f7d90697fda tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:20.465681 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4c5b0527-3427-4a76-832f-9f7d90697fda tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:20.466263 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4c5b0527-3427-4a76-832f-9f7d90697fda tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:20.612899 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-4c5b0527-3427-4a76-832f-9f7d90697fda tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:20.621499 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-4c5b0527-3427-4a76-832f-9f7d90697fda tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:20.623113 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-4c5b0527-3427-4a76-832f-9f7d90697fda tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:20.624219 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-4c5b0527-3427-4a76-832f-9f7d90697fda tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1406 microversion: 2.20 time: 0.171149 May 31 21:04:20.624783 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 83/162] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:04:20 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 21:04:21.236219 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-ccd45e75-43a1-479f-b7fb-9ca2e86867f4 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:21.236911 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-ccd45e75-43a1-479f-b7fb-9ca2e86867f4 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:21.243059 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ccd45e75-43a1-479f-b7fb-9ca2e86867f4 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:21.243508 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ccd45e75-43a1-479f-b7fb-9ca2e86867f4 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:21.244281 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ccd45e75-43a1-479f-b7fb-9ca2e86867f4 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:21.244717 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ccd45e75-43a1-479f-b7fb-9ca2e86867f4 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:21.375088 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-ccd45e75-43a1-479f-b7fb-9ca2e86867f4 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:21.383286 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-ccd45e75-43a1-479f-b7fb-9ca2e86867f4 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1363 microversion: 2.1 time: 0.150867 May 31 21:04:21.383854 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 84/163] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:21 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:04:21.431173 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-ae7000a2-94b6-41e3-b307-82428239ff85 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:21.431775 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-ae7000a2-94b6-41e3-b307-82428239ff85 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 9bff085f-5477-4588-9e08-533189d2db08] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:21.437810 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ae7000a2-94b6-41e3-b307-82428239ff85 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:21.438299 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ae7000a2-94b6-41e3-b307-82428239ff85 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:21.439053 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ae7000a2-94b6-41e3-b307-82428239ff85 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:21.439490 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ae7000a2-94b6-41e3-b307-82428239ff85 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:21.458003 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell1:SELECT=100 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:21.598600 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-ae7000a2-94b6-41e3-b307-82428239ff85 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:21.605998 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-ae7000a2-94b6-41e3-b307-82428239ff85 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08" status: 200 len: 1321 microversion: 2.1 time: 0.179045 May 31 21:04:21.606599 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 85/164] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:21 2022] GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08 => generated 1321 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:04:21.644937 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-a00c7dd2-42fc-4b89-886f-7c7b4074c7de tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:21.645477 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-a00c7dd2-42fc-4b89-886f-7c7b4074c7de tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:21.652254 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a00c7dd2-42fc-4b89-886f-7c7b4074c7de tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:21.652708 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a00c7dd2-42fc-4b89-886f-7c7b4074c7de tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:21.653491 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a00c7dd2-42fc-4b89-886f-7c7b4074c7de tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:21.653951 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a00c7dd2-42fc-4b89-886f-7c7b4074c7de tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:21.789465 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-a00c7dd2-42fc-4b89-886f-7c7b4074c7de tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:21.799949 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-a00c7dd2-42fc-4b89-886f-7c7b4074c7de tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:21.801518 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-a00c7dd2-42fc-4b89-886f-7c7b4074c7de tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:21.802675 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-a00c7dd2-42fc-4b89-886f-7c7b4074c7de tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1406 microversion: 2.20 time: 0.163744 May 31 21:04:21.803244 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 86/165] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:04:21 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 21:04:22.399925 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-c975113c-9e92-4db4-b5dc-43204b186b59 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:22.400557 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-c975113c-9e92-4db4-b5dc-43204b186b59 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:22.406767 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c975113c-9e92-4db4-b5dc-43204b186b59 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:22.407216 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c975113c-9e92-4db4-b5dc-43204b186b59 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:22.407988 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c975113c-9e92-4db4-b5dc-43204b186b59 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:22.408422 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c975113c-9e92-4db4-b5dc-43204b186b59 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:22.540313 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-c975113c-9e92-4db4-b5dc-43204b186b59 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:22.547825 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-c975113c-9e92-4db4-b5dc-43204b186b59 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1363 microversion: 2.1 time: 0.152318 May 31 21:04:22.548415 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 87/166] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:22 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:04:22.624490 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-11a86a52-dd3d-4d72-8ded-eb804e68b626 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:22.625247 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-11a86a52-dd3d-4d72-8ded-eb804e68b626 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 9bff085f-5477-4588-9e08-533189d2db08] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:22.632467 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-11a86a52-dd3d-4d72-8ded-eb804e68b626 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:22.632967 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-11a86a52-dd3d-4d72-8ded-eb804e68b626 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:22.633744 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-11a86a52-dd3d-4d72-8ded-eb804e68b626 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:22.634200 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-11a86a52-dd3d-4d72-8ded-eb804e68b626 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:22.768466 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-11a86a52-dd3d-4d72-8ded-eb804e68b626 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:22.776273 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-11a86a52-dd3d-4d72-8ded-eb804e68b626 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08" status: 200 len: 1321 microversion: 2.1 time: 0.155583 May 31 21:04:22.776852 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 88/167] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:22 2022] GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08 => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:04:22.821700 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-09514805-89c3-4f49-97cc-5b6a8637eca7 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:22.822253 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-09514805-89c3-4f49-97cc-5b6a8637eca7 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:22.830269 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-09514805-89c3-4f49-97cc-5b6a8637eca7 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:22.830743 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-09514805-89c3-4f49-97cc-5b6a8637eca7 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:22.831509 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-09514805-89c3-4f49-97cc-5b6a8637eca7 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:22.831935 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-09514805-89c3-4f49-97cc-5b6a8637eca7 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:22.966611 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-09514805-89c3-4f49-97cc-5b6a8637eca7 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:22.975244 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-09514805-89c3-4f49-97cc-5b6a8637eca7 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:22.976832 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-09514805-89c3-4f49-97cc-5b6a8637eca7 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:22.977963 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-09514805-89c3-4f49-97cc-5b6a8637eca7 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1406 microversion: 2.20 time: 0.160670 May 31 21:04:22.984100 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 89/168] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:04:22 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 21:04:23.565334 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-a5371b00-f9c5-42e8-89ab-d6fd375bbd0d tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:23.566229 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-a5371b00-f9c5-42e8-89ab-d6fd375bbd0d tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:23.573142 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a5371b00-f9c5-42e8-89ab-d6fd375bbd0d tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:23.573794 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a5371b00-f9c5-42e8-89ab-d6fd375bbd0d tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:23.574728 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a5371b00-f9c5-42e8-89ab-d6fd375bbd0d tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:23.575255 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a5371b00-f9c5-42e8-89ab-d6fd375bbd0d tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:23.732722 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-a5371b00-f9c5-42e8-89ab-d6fd375bbd0d tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:23.751037 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-a5371b00-f9c5-42e8-89ab-d6fd375bbd0d tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1363 microversion: 2.1 time: 0.189269 May 31 21:04:23.767831 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 90/169] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:23 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1363 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:04:23.795162 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-aa4a5e9c-c364-4d28-9caa-bb3546532a95 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:23.795678 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-aa4a5e9c-c364-4d28-9caa-bb3546532a95 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 9bff085f-5477-4588-9e08-533189d2db08] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:23.802114 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-aa4a5e9c-c364-4d28-9caa-bb3546532a95 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:23.802573 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-aa4a5e9c-c364-4d28-9caa-bb3546532a95 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:23.804316 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-aa4a5e9c-c364-4d28-9caa-bb3546532a95 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:23.804316 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-aa4a5e9c-c364-4d28-9caa-bb3546532a95 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:23.967945 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-aa4a5e9c-c364-4d28-9caa-bb3546532a95 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:23.975830 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-aa4a5e9c-c364-4d28-9caa-bb3546532a95 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08" status: 200 len: 1321 microversion: 2.1 time: 0.186821 May 31 21:04:23.976414 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 91/170] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:23 2022] GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08 => generated 1321 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:04:24.000881 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-6833b751-17a2-4f11-8e6f-059ec8de4583 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:24.001489 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-6833b751-17a2-4f11-8e6f-059ec8de4583 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:24.008578 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6833b751-17a2-4f11-8e6f-059ec8de4583 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:24.009028 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6833b751-17a2-4f11-8e6f-059ec8de4583 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:24.009802 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6833b751-17a2-4f11-8e6f-059ec8de4583 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:24.010267 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6833b751-17a2-4f11-8e6f-059ec8de4583 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:24.150751 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-6833b751-17a2-4f11-8e6f-059ec8de4583 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:24.159719 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-6833b751-17a2-4f11-8e6f-059ec8de4583 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:24.161222 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-6833b751-17a2-4f11-8e6f-059ec8de4583 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:24.162442 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-6833b751-17a2-4f11-8e6f-059ec8de4583 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1406 microversion: 2.20 time: 0.165582 May 31 21:04:24.163021 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 92/171] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:04:23 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 21:04:24.776833 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-6edb34e0-c2d6-44d3-94d3-8803d3a19fcb tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:24.777545 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-6edb34e0-c2d6-44d3-94d3-8803d3a19fcb tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:24.785193 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6edb34e0-c2d6-44d3-94d3-8803d3a19fcb tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:24.785650 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6edb34e0-c2d6-44d3-94d3-8803d3a19fcb tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:24.786504 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6edb34e0-c2d6-44d3-94d3-8803d3a19fcb tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:24.786951 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6edb34e0-c2d6-44d3-94d3-8803d3a19fcb tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:25.010083 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-6edb34e0-c2d6-44d3-94d3-8803d3a19fcb tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:25.020367 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-6edb34e0-c2d6-44d3-94d3-8803d3a19fcb tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1363 microversion: 2.1 time: 0.248067 May 31 21:04:25.020957 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 93/172] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:24 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1363 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:04:25.026627 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-810fb498-a578-4bef-9d1a-d5bc9c8fda0e tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:25.027227 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-810fb498-a578-4bef-9d1a-d5bc9c8fda0e tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 9bff085f-5477-4588-9e08-533189d2db08] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:25.033506 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-810fb498-a578-4bef-9d1a-d5bc9c8fda0e tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:25.033979 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-810fb498-a578-4bef-9d1a-d5bc9c8fda0e tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:25.034772 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-810fb498-a578-4bef-9d1a-d5bc9c8fda0e tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:25.035185 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-810fb498-a578-4bef-9d1a-d5bc9c8fda0e tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:25.173080 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-810fb498-a578-4bef-9d1a-d5bc9c8fda0e tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:25.182197 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-810fb498-a578-4bef-9d1a-d5bc9c8fda0e tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08" status: 200 len: 1321 microversion: 2.1 time: 0.159927 May 31 21:04:25.182779 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 94/173] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:25 2022] GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:04:25.187276 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-30a9a7cb-ee70-41ed-bc36-84865915a169 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:25.187878 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-30a9a7cb-ee70-41ed-bc36-84865915a169 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:25.193836 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-30a9a7cb-ee70-41ed-bc36-84865915a169 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:25.194325 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-30a9a7cb-ee70-41ed-bc36-84865915a169 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:25.195753 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-30a9a7cb-ee70-41ed-bc36-84865915a169 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:25.196189 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-30a9a7cb-ee70-41ed-bc36-84865915a169 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:25.339058 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-30a9a7cb-ee70-41ed-bc36-84865915a169 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:25.347264 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-30a9a7cb-ee70-41ed-bc36-84865915a169 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:25.348763 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-30a9a7cb-ee70-41ed-bc36-84865915a169 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:25.349873 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-30a9a7cb-ee70-41ed-bc36-84865915a169 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1406 microversion: 2.20 time: 0.166178 May 31 21:04:25.350453 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 95/174] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:04:25 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:04:26.047517 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-c4a60f75-2839-4618-b16d-2858989c8cd0 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:26.048943 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-c4a60f75-2839-4618-b16d-2858989c8cd0 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:26.057337 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c4a60f75-2839-4618-b16d-2858989c8cd0 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:26.057822 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c4a60f75-2839-4618-b16d-2858989c8cd0 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:26.058670 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c4a60f75-2839-4618-b16d-2858989c8cd0 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:26.059467 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c4a60f75-2839-4618-b16d-2858989c8cd0 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:26.213879 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-c4a60f75-2839-4618-b16d-2858989c8cd0 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:26.222419 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-c4a60f75-2839-4618-b16d-2858989c8cd0 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1363 microversion: 2.1 time: 0.179518 May 31 21:04:26.223002 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 96/175] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:26 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:04:26.228466 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-f1956429-32e0-4eb7-a204-2cb8ea097bb0 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:26.229090 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-f1956429-32e0-4eb7-a204-2cb8ea097bb0 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 9bff085f-5477-4588-9e08-533189d2db08] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:26.235725 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f1956429-32e0-4eb7-a204-2cb8ea097bb0 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:26.236173 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f1956429-32e0-4eb7-a204-2cb8ea097bb0 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:26.237023 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f1956429-32e0-4eb7-a204-2cb8ea097bb0 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:26.237470 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f1956429-32e0-4eb7-a204-2cb8ea097bb0 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:26.384503 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-f1956429-32e0-4eb7-a204-2cb8ea097bb0 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:26.394021 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-f1956429-32e0-4eb7-a204-2cb8ea097bb0 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08" status: 200 len: 1321 microversion: 2.1 time: 0.169915 May 31 21:04:26.404532 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 97/176] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:26 2022] GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08 => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:04:26.404532 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-0124d104-ef96-4265-a9fb-3e5d3e392870 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:26.404532 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-0124d104-ef96-4265-a9fb-3e5d3e392870 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:26.408163 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-0124d104-ef96-4265-a9fb-3e5d3e392870 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:26.408163 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-0124d104-ef96-4265-a9fb-3e5d3e392870 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:26.408921 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-0124d104-ef96-4265-a9fb-3e5d3e392870 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:26.409395 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-0124d104-ef96-4265-a9fb-3e5d3e392870 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:26.573357 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-0124d104-ef96-4265-a9fb-3e5d3e392870 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:26.582832 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-0124d104-ef96-4265-a9fb-3e5d3e392870 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:26.584894 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-0124d104-ef96-4265-a9fb-3e5d3e392870 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:26.586239 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-0124d104-ef96-4265-a9fb-3e5d3e392870 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1406 microversion: 2.20 time: 0.190696 May 31 21:04:26.586838 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 98/177] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:04:26 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1406 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:04:27.240202 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-0b3e24a8-155a-47c5-bdc8-3320b9a3c2d0 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:27.240852 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-0b3e24a8-155a-47c5-bdc8-3320b9a3c2d0 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:27.248170 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-0b3e24a8-155a-47c5-bdc8-3320b9a3c2d0 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:27.248457 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-0b3e24a8-155a-47c5-bdc8-3320b9a3c2d0 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:27.249241 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-0b3e24a8-155a-47c5-bdc8-3320b9a3c2d0 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:27.249717 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-0b3e24a8-155a-47c5-bdc8-3320b9a3c2d0 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:27.414009 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-0b3e24a8-155a-47c5-bdc8-3320b9a3c2d0 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:27.422192 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-0b3e24a8-155a-47c5-bdc8-3320b9a3c2d0 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1363 microversion: 2.1 time: 0.185853 May 31 21:04:27.422783 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 99/178] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:27 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:04:27.427482 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-4a4778d4-eb4b-4b4f-aa4d-46744564d99d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:27.432311 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-4a4778d4-eb4b-4b4f-aa4d-46744564d99d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 9bff085f-5477-4588-9e08-533189d2db08] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:27.437152 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4a4778d4-eb4b-4b4f-aa4d-46744564d99d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:27.437595 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4a4778d4-eb4b-4b4f-aa4d-46744564d99d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:27.438487 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4a4778d4-eb4b-4b4f-aa4d-46744564d99d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:27.438926 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4a4778d4-eb4b-4b4f-aa4d-46744564d99d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:27.601797 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-4a4778d4-eb4b-4b4f-aa4d-46744564d99d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:27.609680 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-4a4778d4-eb4b-4b4f-aa4d-46744564d99d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08" status: 200 len: 1321 microversion: 2.1 time: 0.185833 May 31 21:04:27.610310 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 100/179] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:27 2022] GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08 => generated 1321 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:04:27.614988 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-bf0cae38-59ef-4b9d-982e-c762f2e702e3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:27.615593 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-bf0cae38-59ef-4b9d-982e-c762f2e702e3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:27.621807 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-bf0cae38-59ef-4b9d-982e-c762f2e702e3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:27.622290 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-bf0cae38-59ef-4b9d-982e-c762f2e702e3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:27.623245 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-bf0cae38-59ef-4b9d-982e-c762f2e702e3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:27.623684 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-bf0cae38-59ef-4b9d-982e-c762f2e702e3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:27.761032 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-bf0cae38-59ef-4b9d-982e-c762f2e702e3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:27.769093 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-bf0cae38-59ef-4b9d-982e-c762f2e702e3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:27.770610 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-bf0cae38-59ef-4b9d-982e-c762f2e702e3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:27.771704 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-bf0cae38-59ef-4b9d-982e-c762f2e702e3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1406 microversion: 2.20 time: 0.160485 May 31 21:04:27.772273 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 101/180] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:04:27 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:04:27.930778 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_api:SELECT=19 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:28.459799 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-e1a7fa8e-67c2-4036-aa5f-f8c8d93981ca tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:28.461125 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-e1a7fa8e-67c2-4036-aa5f-f8c8d93981ca tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:28.468644 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e1a7fa8e-67c2-4036-aa5f-f8c8d93981ca tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:28.469091 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e1a7fa8e-67c2-4036-aa5f-f8c8d93981ca tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:28.469879 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e1a7fa8e-67c2-4036-aa5f-f8c8d93981ca tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:28.470505 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e1a7fa8e-67c2-4036-aa5f-f8c8d93981ca tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:28.499492 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell1:SELECT=100 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:28.554830 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell1:SELECT=41 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:28.678160 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-e1a7fa8e-67c2-4036-aa5f-f8c8d93981ca tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:28.698838 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-e1a7fa8e-67c2-4036-aa5f-f8c8d93981ca tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1363 microversion: 2.1 time: 0.247912 May 31 21:04:28.701399 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 102/181] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:28 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1363 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:04:28.726631 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-f2aabe4b-2fbd-437b-ab83-618e3d8ed6dc tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:28.727927 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-f2aabe4b-2fbd-437b-ab83-618e3d8ed6dc tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 9bff085f-5477-4588-9e08-533189d2db08] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:28.743082 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f2aabe4b-2fbd-437b-ab83-618e3d8ed6dc tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:28.744860 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f2aabe4b-2fbd-437b-ab83-618e3d8ed6dc tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:28.746672 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f2aabe4b-2fbd-437b-ab83-618e3d8ed6dc tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:28.747551 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f2aabe4b-2fbd-437b-ab83-618e3d8ed6dc tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:28.928219 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-f2aabe4b-2fbd-437b-ab83-618e3d8ed6dc tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:28.938616 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-f2aabe4b-2fbd-437b-ab83-618e3d8ed6dc tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08" status: 200 len: 1321 microversion: 2.1 time: 0.236776 May 31 21:04:28.939642 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 103/182] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:28 2022] GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08 => generated 1321 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:04:28.952282 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-e4e26aa8-b6f3-42bc-93b8-30e1a44255a8 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:28.952282 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-e4e26aa8-b6f3-42bc-93b8-30e1a44255a8 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:28.955113 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e4e26aa8-b6f3-42bc-93b8-30e1a44255a8 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:28.955647 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e4e26aa8-b6f3-42bc-93b8-30e1a44255a8 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:28.956521 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e4e26aa8-b6f3-42bc-93b8-30e1a44255a8 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:28.957038 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e4e26aa8-b6f3-42bc-93b8-30e1a44255a8 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:29.111430 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-e4e26aa8-b6f3-42bc-93b8-30e1a44255a8 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:29.121347 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-e4e26aa8-b6f3-42bc-93b8-30e1a44255a8 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:29.123491 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-e4e26aa8-b6f3-42bc-93b8-30e1a44255a8 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:29.124789 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-e4e26aa8-b6f3-42bc-93b8-30e1a44255a8 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1406 microversion: 2.20 time: 0.183815 May 31 21:04:29.135898 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 104/183] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:04:28 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1406 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:04:29.135898 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [req-efb10577-1ebf-4ee2-93ed-7d5adbd98e1c req-565d35da-c83f-47c2-8eac-95c315b35a5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a123764b-4693-41b1-bad8-a1a63cc951cd", "name": "network-vif-plugged", "status": "completed", "tag": "cc0edf95-fc02-451a-b38f-075bee275ed6"}]} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:04:29.143977 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-efb10577-1ebf-4ee2-93ed-7d5adbd98e1c req-565d35da-c83f-47c2-8eac-95c315b35a5a service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:29.145033 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-efb10577-1ebf-4ee2-93ed-7d5adbd98e1c req-565d35da-c83f-47c2-8eac-95c315b35a5a service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:29.158284 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.compute.server_external_events [req-efb10577-1ebf-4ee2-93ed-7d5adbd98e1c req-565d35da-c83f-47c2-8eac-95c315b35a5a service nova] Creating event network-vif-plugged:cc0edf95-fc02-451a-b38f-075bee275ed6 for instance a123764b-4693-41b1-bad8-a1a63cc951cd on hv-cinder-83979 May 31 21:04:29.164940 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [req-efb10577-1ebf-4ee2-93ed-7d5adbd98e1c req-565d35da-c83f-47c2-8eac-95c315b35a5a service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037393 May 31 21:04:29.165553 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 105/184] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:04:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:04:29.719354 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-f934a62a-1b52-4c99-aea6-463267aa1051 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:29.720519 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-f934a62a-1b52-4c99-aea6-463267aa1051 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:29.730528 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f934a62a-1b52-4c99-aea6-463267aa1051 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:29.731109 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f934a62a-1b52-4c99-aea6-463267aa1051 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:29.732213 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f934a62a-1b52-4c99-aea6-463267aa1051 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:29.733076 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f934a62a-1b52-4c99-aea6-463267aa1051 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:29.948138 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-f934a62a-1b52-4c99-aea6-463267aa1051 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:29.956147 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-f934a62a-1b52-4c99-aea6-463267aa1051 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1363 microversion: 2.1 time: 0.242452 May 31 21:04:29.962933 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 106/185] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:29 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1363 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:04:29.962933 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-a4ede90e-2b52-4f7c-87f8-dd09a578740d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:29.962933 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-a4ede90e-2b52-4f7c-87f8-dd09a578740d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 9bff085f-5477-4588-9e08-533189d2db08] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:29.968324 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a4ede90e-2b52-4f7c-87f8-dd09a578740d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:29.968937 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a4ede90e-2b52-4f7c-87f8-dd09a578740d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:29.969847 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a4ede90e-2b52-4f7c-87f8-dd09a578740d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:29.970446 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a4ede90e-2b52-4f7c-87f8-dd09a578740d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:30.128536 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-a4ede90e-2b52-4f7c-87f8-dd09a578740d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:30.157489 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-a4ede90e-2b52-4f7c-87f8-dd09a578740d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08" status: 200 len: 1321 microversion: 2.1 time: 0.199252 May 31 21:04:30.158225 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 107/186] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:29 2022] GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08 => generated 1321 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:04:30.164072 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-67ef2b8a-5022-4f73-9f70-cdc2e6d55853 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:30.164813 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-67ef2b8a-5022-4f73-9f70-cdc2e6d55853 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:30.171462 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-67ef2b8a-5022-4f73-9f70-cdc2e6d55853 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:30.172006 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-67ef2b8a-5022-4f73-9f70-cdc2e6d55853 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:30.172811 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-67ef2b8a-5022-4f73-9f70-cdc2e6d55853 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:30.173260 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-67ef2b8a-5022-4f73-9f70-cdc2e6d55853 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:30.309047 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-67ef2b8a-5022-4f73-9f70-cdc2e6d55853 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:30.317428 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-67ef2b8a-5022-4f73-9f70-cdc2e6d55853 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:30.318947 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-67ef2b8a-5022-4f73-9f70-cdc2e6d55853 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:30.320128 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-67ef2b8a-5022-4f73-9f70-cdc2e6d55853 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1406 microversion: 2.20 time: 0.160856 May 31 21:04:30.320962 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 108/187] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:04:30 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:04:30.972606 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-e350292d-0089-4e3f-9a48-87b7b31f8d0a tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:30.973310 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-e350292d-0089-4e3f-9a48-87b7b31f8d0a tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:30.980399 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e350292d-0089-4e3f-9a48-87b7b31f8d0a tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:30.980842 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e350292d-0089-4e3f-9a48-87b7b31f8d0a tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:30.981611 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e350292d-0089-4e3f-9a48-87b7b31f8d0a tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:30.982085 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e350292d-0089-4e3f-9a48-87b7b31f8d0a tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:31.141074 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-e350292d-0089-4e3f-9a48-87b7b31f8d0a tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:31.151600 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-e350292d-0089-4e3f-9a48-87b7b31f8d0a tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1363 microversion: 2.1 time: 0.182777 May 31 21:04:31.152489 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 109/188] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:30 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:04:31.179285 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-b68557c3-c338-4cab-9a30-780ae344521d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:31.179646 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-b68557c3-c338-4cab-9a30-780ae344521d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 9bff085f-5477-4588-9e08-533189d2db08] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:31.185858 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b68557c3-c338-4cab-9a30-780ae344521d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:31.186343 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b68557c3-c338-4cab-9a30-780ae344521d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:31.187117 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b68557c3-c338-4cab-9a30-780ae344521d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:31.187561 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b68557c3-c338-4cab-9a30-780ae344521d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:31.323265 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-b68557c3-c338-4cab-9a30-780ae344521d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:31.331370 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-b68557c3-c338-4cab-9a30-780ae344521d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08" status: 200 len: 1321 microversion: 2.1 time: 0.156501 May 31 21:04:31.333992 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 110/189] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:31 2022] GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08 => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:04:31.345704 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-2bf1395b-f2c0-4f07-ac43-6a95de282b00 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:31.345704 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-2bf1395b-f2c0-4f07-ac43-6a95de282b00 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:31.346398 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2bf1395b-f2c0-4f07-ac43-6a95de282b00 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:31.346525 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2bf1395b-f2c0-4f07-ac43-6a95de282b00 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:31.347262 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2bf1395b-f2c0-4f07-ac43-6a95de282b00 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:31.347692 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2bf1395b-f2c0-4f07-ac43-6a95de282b00 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:31.482159 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-2bf1395b-f2c0-4f07-ac43-6a95de282b00 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:31.491719 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-2bf1395b-f2c0-4f07-ac43-6a95de282b00 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:31.493295 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-2bf1395b-f2c0-4f07-ac43-6a95de282b00 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:31.494470 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-2bf1395b-f2c0-4f07-ac43-6a95de282b00 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1406 microversion: 2.20 time: 0.159420 May 31 21:04:31.495229 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 111/190] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:04:31 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:04:32.168892 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-5f692168-8570-459c-9a4e-6b808996ab1b tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:32.169629 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-5f692168-8570-459c-9a4e-6b808996ab1b tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:32.181010 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5f692168-8570-459c-9a4e-6b808996ab1b tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:32.181815 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5f692168-8570-459c-9a4e-6b808996ab1b tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:32.183539 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5f692168-8570-459c-9a4e-6b808996ab1b tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:32.184579 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5f692168-8570-459c-9a4e-6b808996ab1b tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:32.404412 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-5f692168-8570-459c-9a4e-6b808996ab1b tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:32.413743 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-5f692168-8570-459c-9a4e-6b808996ab1b tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1363 microversion: 2.1 time: 0.248719 May 31 21:04:32.414746 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 112/191] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:32 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1363 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:04:32.427532 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [req-09c7f8e4-2b40-4a3d-b3a8-98236f38dcc9 req-e3dddd3f-6f89-4a77-b596-abe47d402c34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bff085f-5477-4588-9e08-533189d2db08", "name": "network-vif-plugged", "status": "completed", "tag": "31db06ed-717e-4c7e-8538-117ccbffa87d"}]} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:04:32.436563 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-09c7f8e4-2b40-4a3d-b3a8-98236f38dcc9 req-e3dddd3f-6f89-4a77-b596-abe47d402c34 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:32.437077 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-09c7f8e4-2b40-4a3d-b3a8-98236f38dcc9 req-e3dddd3f-6f89-4a77-b596-abe47d402c34 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:32.450574 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.compute.server_external_events [req-09c7f8e4-2b40-4a3d-b3a8-98236f38dcc9 req-e3dddd3f-6f89-4a77-b596-abe47d402c34 service nova] Creating event network-vif-plugged:31db06ed-717e-4c7e-8538-117ccbffa87d for instance 9bff085f-5477-4588-9e08-533189d2db08 on hv-cinder-83979 May 31 21:04:32.456469 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [req-09c7f8e4-2b40-4a3d-b3a8-98236f38dcc9 req-e3dddd3f-6f89-4a77-b596-abe47d402c34 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040250 May 31 21:04:32.457265 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 113/192] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:04:32.465071 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-0f95bde6-5d01-4257-8d0a-fdc9d8b8f76c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:32.465826 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-0f95bde6-5d01-4257-8d0a-fdc9d8b8f76c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 9bff085f-5477-4588-9e08-533189d2db08] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:32.472894 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-0f95bde6-5d01-4257-8d0a-fdc9d8b8f76c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:32.473352 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-0f95bde6-5d01-4257-8d0a-fdc9d8b8f76c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:32.474177 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-0f95bde6-5d01-4257-8d0a-fdc9d8b8f76c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:32.474616 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-0f95bde6-5d01-4257-8d0a-fdc9d8b8f76c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:32.608615 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-0f95bde6-5d01-4257-8d0a-fdc9d8b8f76c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:32.616431 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-0f95bde6-5d01-4257-8d0a-fdc9d8b8f76c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08" status: 200 len: 1321 microversion: 2.1 time: 0.158237 May 31 21:04:32.617522 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 114/193] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:32 2022] GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08 => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:04:32.621925 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-59e182bd-d5fe-40e8-af71-0dce7711d68b tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:32.622521 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-59e182bd-d5fe-40e8-af71-0dce7711d68b tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:32.628184 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-59e182bd-d5fe-40e8-af71-0dce7711d68b tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:32.628631 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-59e182bd-d5fe-40e8-af71-0dce7711d68b tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:32.629381 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-59e182bd-d5fe-40e8-af71-0dce7711d68b tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:32.629808 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-59e182bd-d5fe-40e8-af71-0dce7711d68b tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:32.767742 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-59e182bd-d5fe-40e8-af71-0dce7711d68b tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:32.776069 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-59e182bd-d5fe-40e8-af71-0dce7711d68b tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:32.777500 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-59e182bd-d5fe-40e8-af71-0dce7711d68b tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:32.778875 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-59e182bd-d5fe-40e8-af71-0dce7711d68b tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1406 microversion: 2.20 time: 0.160210 May 31 21:04:32.779438 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 115/194] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:04:32 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:04:33.432100 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-22c8ac7b-2f4f-4b53-aec9-8f415efc5ce9 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:33.433263 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-22c8ac7b-2f4f-4b53-aec9-8f415efc5ce9 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:33.440457 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-22c8ac7b-2f4f-4b53-aec9-8f415efc5ce9 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:33.441210 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-22c8ac7b-2f4f-4b53-aec9-8f415efc5ce9 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:33.441756 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-22c8ac7b-2f4f-4b53-aec9-8f415efc5ce9 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:33.442349 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-22c8ac7b-2f4f-4b53-aec9-8f415efc5ce9 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:33.674634 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-22c8ac7b-2f4f-4b53-aec9-8f415efc5ce9 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:33.686068 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-22c8ac7b-2f4f-4b53-aec9-8f415efc5ce9 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1363 microversion: 2.1 time: 0.258263 May 31 21:04:33.687368 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 116/195] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:33 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1363 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:04:33.692483 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-8cc04eb9-b194-4260-80c1-3402eda0ce78 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:33.694182 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-8cc04eb9-b194-4260-80c1-3402eda0ce78 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 9bff085f-5477-4588-9e08-533189d2db08] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:33.713500 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-8cc04eb9-b194-4260-80c1-3402eda0ce78 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:33.713996 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-8cc04eb9-b194-4260-80c1-3402eda0ce78 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:33.715022 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-8cc04eb9-b194-4260-80c1-3402eda0ce78 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:33.715739 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-8cc04eb9-b194-4260-80c1-3402eda0ce78 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:33.994093 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-8cc04eb9-b194-4260-80c1-3402eda0ce78 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:34.004210 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-8cc04eb9-b194-4260-80c1-3402eda0ce78 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08" status: 200 len: 1321 microversion: 2.1 time: 0.315102 May 31 21:04:34.013992 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 117/196] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:33 2022] GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08 => generated 1321 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:04:34.019673 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-87eff544-7b7c-4a0b-ab87-3f152565d59b tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:34.020699 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-87eff544-7b7c-4a0b-ab87-3f152565d59b tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:34.023721 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_api:SELECT=100 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:34.029915 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-87eff544-7b7c-4a0b-ab87-3f152565d59b tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:34.030977 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-87eff544-7b7c-4a0b-ab87-3f152565d59b tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:34.032563 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-87eff544-7b7c-4a0b-ab87-3f152565d59b tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:34.033780 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-87eff544-7b7c-4a0b-ab87-3f152565d59b tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:34.203254 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-87eff544-7b7c-4a0b-ab87-3f152565d59b tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:34.213071 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-87eff544-7b7c-4a0b-ab87-3f152565d59b tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:34.214615 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-87eff544-7b7c-4a0b-ab87-3f152565d59b tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:34.215734 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-87eff544-7b7c-4a0b-ab87-3f152565d59b tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1406 microversion: 2.20 time: 0.208579 May 31 21:04:34.216300 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 118/197] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:04:34 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1406 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:04:34.722365 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-450ef1ba-6e48-4c49-828b-c692cdb80568 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:34.725067 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-450ef1ba-6e48-4c49-828b-c692cdb80568 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:34.741313 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-450ef1ba-6e48-4c49-828b-c692cdb80568 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:34.748822 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-450ef1ba-6e48-4c49-828b-c692cdb80568 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:34.748822 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-450ef1ba-6e48-4c49-828b-c692cdb80568 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:34.748822 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-450ef1ba-6e48-4c49-828b-c692cdb80568 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:34.947808 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-450ef1ba-6e48-4c49-828b-c692cdb80568 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:34.959581 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-450ef1ba-6e48-4c49-828b-c692cdb80568 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1363 microversion: 2.1 time: 0.243950 May 31 21:04:34.962136 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 119/198] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:34 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1363 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:04:35.021641 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-2d345059-726b-4f90-a4ae-29768cb7404a tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:35.022559 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-2d345059-726b-4f90-a4ae-29768cb7404a tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 9bff085f-5477-4588-9e08-533189d2db08] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:35.029887 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2d345059-726b-4f90-a4ae-29768cb7404a tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:35.033392 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2d345059-726b-4f90-a4ae-29768cb7404a tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:35.034227 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2d345059-726b-4f90-a4ae-29768cb7404a tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:35.034678 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2d345059-726b-4f90-a4ae-29768cb7404a tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:35.045935 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell1:SELECT=100 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:35.198725 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-f0d50462-ee3f-4daf-a860-1538a81353ac tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] 10.222.0.55 "POST /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 17.277471 May 31 21:04:35.199770 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 80/199] 10.222.0.55 () {60 vars in 1322 bytes} [Tue May 31 21:04:17 2022] POST /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8/os-volume_attachments => generated 194 bytes in 17280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 21:04:35.235688 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-b8832c79-5fa4-4249-983b-891130485f48 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:35.235688 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-b8832c79-5fa4-4249-983b-891130485f48 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:35.250611 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b8832c79-5fa4-4249-983b-891130485f48 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:35.252497 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-2d345059-726b-4f90-a4ae-29768cb7404a tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:35.253358 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b8832c79-5fa4-4249-983b-891130485f48 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:35.254822 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b8832c79-5fa4-4249-983b-891130485f48 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:35.255540 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b8832c79-5fa4-4249-983b-891130485f48 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:35.281803 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-2d345059-726b-4f90-a4ae-29768cb7404a tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08" status: 200 len: 1321 microversion: 2.1 time: 0.263736 May 31 21:04:35.283928 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 120/200] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:35 2022] GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08 => generated 1321 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:04:35.447973 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-b8832c79-5fa4-4249-983b-891130485f48 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:35.456725 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-b8832c79-5fa4-4249-983b-891130485f48 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:35.458288 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-b8832c79-5fa4-4249-983b-891130485f48 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:35.459459 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-b8832c79-5fa4-4249-983b-891130485f48 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1406 microversion: 2.20 time: 0.229154 May 31 21:04:35.460042 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 81/201] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:04:35 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1406 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 21:04:35.990968 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-057b1843-2baa-4514-bcdf-8a435af404ba tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:35.992131 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-057b1843-2baa-4514-bcdf-8a435af404ba tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:36.004505 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-057b1843-2baa-4514-bcdf-8a435af404ba tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:36.005395 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-057b1843-2baa-4514-bcdf-8a435af404ba tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:36.007101 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-057b1843-2baa-4514-bcdf-8a435af404ba tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:36.008734 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-057b1843-2baa-4514-bcdf-8a435af404ba tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:36.239376 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-057b1843-2baa-4514-bcdf-8a435af404ba tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:36.249931 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-057b1843-2baa-4514-bcdf-8a435af404ba tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1363 microversion: 2.1 time: 0.268556 May 31 21:04:36.250633 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 121/202] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:35 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1363 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:04:36.306611 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-de4efb5a-3325-4fad-9a21-59d1568ec357 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:36.307236 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-de4efb5a-3325-4fad-9a21-59d1568ec357 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 9bff085f-5477-4588-9e08-533189d2db08] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:36.316808 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-de4efb5a-3325-4fad-9a21-59d1568ec357 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:36.316808 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-de4efb5a-3325-4fad-9a21-59d1568ec357 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:36.316808 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-de4efb5a-3325-4fad-9a21-59d1568ec357 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:36.316808 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-de4efb5a-3325-4fad-9a21-59d1568ec357 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:36.362546 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [req-b90c8361-1b47-4518-9c73-f7d2f7da2550 req-e95ea2bc-965f-4e41-b29b-380f2af4c86a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faf12fce-2352-40df-a297-0d7b28379014", "name": "network-vif-plugged", "status": "completed", "tag": "eb53f5b6-46bd-4009-8d09-18c62dd763ce"}]} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:04:36.379094 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-b90c8361-1b47-4518-9c73-f7d2f7da2550 req-e95ea2bc-965f-4e41-b29b-380f2af4c86a service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:36.379550 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-b90c8361-1b47-4518-9c73-f7d2f7da2550 req-e95ea2bc-965f-4e41-b29b-380f2af4c86a service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:36.407721 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.compute.server_external_events [req-b90c8361-1b47-4518-9c73-f7d2f7da2550 req-e95ea2bc-965f-4e41-b29b-380f2af4c86a service nova] Creating event network-vif-plugged:eb53f5b6-46bd-4009-8d09-18c62dd763ce for instance faf12fce-2352-40df-a297-0d7b28379014 on hv-cinder-83979 May 31 21:04:36.416104 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [req-b90c8361-1b47-4518-9c73-f7d2f7da2550 req-e95ea2bc-965f-4e41-b29b-380f2af4c86a service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057793 May 31 21:04:36.416728 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 122/203] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 21:04:36.485061 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-1508db68-2ba5-49db-bbd3-1da06509dd88 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:36.492719 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-de4efb5a-3325-4fad-9a21-59d1568ec357 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:36.497167 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-1508db68-2ba5-49db-bbd3-1da06509dd88 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:36.505411 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-de4efb5a-3325-4fad-9a21-59d1568ec357 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08" status: 200 len: 1321 microversion: 2.1 time: 0.203815 May 31 21:04:36.506904 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 82/204] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:36 2022] GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08 => generated 1321 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:04:36.514388 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-1508db68-2ba5-49db-bbd3-1da06509dd88 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:36.515045 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-1508db68-2ba5-49db-bbd3-1da06509dd88 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:36.515904 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-1508db68-2ba5-49db-bbd3-1da06509dd88 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:36.516735 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-1508db68-2ba5-49db-bbd3-1da06509dd88 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:36.703389 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-1508db68-2ba5-49db-bbd3-1da06509dd88 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:36.712747 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-1508db68-2ba5-49db-bbd3-1da06509dd88 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:36.714277 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-1508db68-2ba5-49db-bbd3-1da06509dd88 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:36.715489 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-1508db68-2ba5-49db-bbd3-1da06509dd88 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1406 microversion: 2.20 time: 0.240708 May 31 21:04:36.716380 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 123/205] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:04:36 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1406 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 21:04:37.280455 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-5e78a0b3-8304-4a16-991b-f594d151b18c tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:37.281152 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-5e78a0b3-8304-4a16-991b-f594d151b18c tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:37.288592 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-5e78a0b3-8304-4a16-991b-f594d151b18c tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:37.289271 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-5e78a0b3-8304-4a16-991b-f594d151b18c tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:37.290785 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-5e78a0b3-8304-4a16-991b-f594d151b18c tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:37.291239 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-5e78a0b3-8304-4a16-991b-f594d151b18c tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:37.464634 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-5e78a0b3-8304-4a16-991b-f594d151b18c tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:37.475934 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-5e78a0b3-8304-4a16-991b-f594d151b18c tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1363 microversion: 2.1 time: 0.199868 May 31 21:04:37.481944 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 83/206] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:37 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1363 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:04:37.528443 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-2b8f166c-21ea-4841-8846-4ef777b49d8d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:37.528443 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-2b8f166c-21ea-4841-8846-4ef777b49d8d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 9bff085f-5477-4588-9e08-533189d2db08] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:37.532191 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2b8f166c-21ea-4841-8846-4ef777b49d8d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:37.532690 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2b8f166c-21ea-4841-8846-4ef777b49d8d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:37.533579 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2b8f166c-21ea-4841-8846-4ef777b49d8d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:37.534138 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2b8f166c-21ea-4841-8846-4ef777b49d8d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:37.680389 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-2b8f166c-21ea-4841-8846-4ef777b49d8d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:37.688933 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-2b8f166c-21ea-4841-8846-4ef777b49d8d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08" status: 200 len: 1321 microversion: 2.1 time: 0.169559 May 31 21:04:37.689523 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 124/207] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:37 2022] GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08 => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:04:37.737864 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-a8ed9b0c-74c6-4921-aec1-111df51c2d79 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:37.740687 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-a8ed9b0c-74c6-4921-aec1-111df51c2d79 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:37.749238 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a8ed9b0c-74c6-4921-aec1-111df51c2d79 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:37.749687 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a8ed9b0c-74c6-4921-aec1-111df51c2d79 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:37.750511 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a8ed9b0c-74c6-4921-aec1-111df51c2d79 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:37.750947 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a8ed9b0c-74c6-4921-aec1-111df51c2d79 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:37.915130 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-a8ed9b0c-74c6-4921-aec1-111df51c2d79 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:37.923366 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-a8ed9b0c-74c6-4921-aec1-111df51c2d79 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:37.924891 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-a8ed9b0c-74c6-4921-aec1-111df51c2d79 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:37.926045 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-a8ed9b0c-74c6-4921-aec1-111df51c2d79 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1406 microversion: 2.20 time: 0.195766 May 31 21:04:37.926575 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 84/208] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:04:37 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1406 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:04:38.531665 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-37cfeb5e-5787-4ab1-bd1f-7e5452dbc9ef tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:38.531665 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-37cfeb5e-5787-4ab1-bd1f-7e5452dbc9ef tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:38.531665 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-37cfeb5e-5787-4ab1-bd1f-7e5452dbc9ef tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:38.531665 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-37cfeb5e-5787-4ab1-bd1f-7e5452dbc9ef tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:38.532629 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-37cfeb5e-5787-4ab1-bd1f-7e5452dbc9ef tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:38.532629 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-37cfeb5e-5787-4ab1-bd1f-7e5452dbc9ef tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:38.660844 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-37cfeb5e-5787-4ab1-bd1f-7e5452dbc9ef tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:38.669512 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-37cfeb5e-5787-4ab1-bd1f-7e5452dbc9ef tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1363 microversion: 2.1 time: 0.179189 May 31 21:04:38.670127 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 125/209] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:38 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:04:38.713397 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-df8fa3d1-1293-4c2f-86bb-e03097345707 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:38.714742 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-df8fa3d1-1293-4c2f-86bb-e03097345707 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 9bff085f-5477-4588-9e08-533189d2db08] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:38.721425 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-df8fa3d1-1293-4c2f-86bb-e03097345707 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:38.721856 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-df8fa3d1-1293-4c2f-86bb-e03097345707 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:38.722658 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-df8fa3d1-1293-4c2f-86bb-e03097345707 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:38.723198 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-df8fa3d1-1293-4c2f-86bb-e03097345707 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:38.874391 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-df8fa3d1-1293-4c2f-86bb-e03097345707 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:38.882201 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-df8fa3d1-1293-4c2f-86bb-e03097345707 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08" status: 200 len: 1516 microversion: 2.1 time: 0.172737 May 31 21:04:38.883621 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 85/210] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:38 2022] GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08 => generated 1516 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:04:38.909928 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-374b327a-6d28-4e47-a133-e844ec55f995 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:04:38.910985 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-374b327a-6d28-4e47-a133-e844ec55f995 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 9bff085f-5477-4588-9e08-533189d2db08] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:38.919301 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-374b327a-6d28-4e47-a133-e844ec55f995 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:38.919764 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-374b327a-6d28-4e47-a133-e844ec55f995 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:38.920551 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-374b327a-6d28-4e47-a133-e844ec55f995 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:38.920994 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-374b327a-6d28-4e47-a133-e844ec55f995 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:38.955306 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-1207f2f2-2fcd-40e5-8a91-25f66882fcc6 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:38.955306 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-1207f2f2-2fcd-40e5-8a91-25f66882fcc6 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:38.962230 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-1207f2f2-2fcd-40e5-8a91-25f66882fcc6 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:38.963008 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-1207f2f2-2fcd-40e5-8a91-25f66882fcc6 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:38.964602 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-1207f2f2-2fcd-40e5-8a91-25f66882fcc6 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:38.965164 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-1207f2f2-2fcd-40e5-8a91-25f66882fcc6 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:39.011406 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.objects.instance [None req-374b327a-6d28-4e47-a133-e844ec55f995 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lazy-loading 'flavor' on Instance uuid 9bff085f-5477-4588-9e08-533189d2db08 {{(pid=118184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 21:04:39.165289 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-1207f2f2-2fcd-40e5-8a91-25f66882fcc6 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:39.176485 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-1207f2f2-2fcd-40e5-8a91-25f66882fcc6 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:39.178239 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-1207f2f2-2fcd-40e5-8a91-25f66882fcc6 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:39.180013 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-1207f2f2-2fcd-40e5-8a91-25f66882fcc6 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1406 microversion: 2.20 time: 0.238042 May 31 21:04:39.180996 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 86/211] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:04:38 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1406 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 21:04:39.472960 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-374b327a-6d28-4e47-a133-e844ec55f995 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "POST /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08/action" status: 200 len: 32 microversion: 2.1 time: 0.566821 May 31 21:04:39.473841 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 126/212] 10.222.0.55 () {60 vars in 1277 bytes} [Tue May 31 21:04:38 2022] POST /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08/action => generated 32 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 31 21:04:39.483565 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-8e332ebf-d30a-41ce-9cf8-dc4089c75f04 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:39.484262 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-8e332ebf-d30a-41ce-9cf8-dc4089c75f04 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 9bff085f-5477-4588-9e08-533189d2db08] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:39.490685 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-8e332ebf-d30a-41ce-9cf8-dc4089c75f04 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:39.494991 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-8e332ebf-d30a-41ce-9cf8-dc4089c75f04 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:39.494991 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-8e332ebf-d30a-41ce-9cf8-dc4089c75f04 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:39.494991 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-8e332ebf-d30a-41ce-9cf8-dc4089c75f04 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:39.648945 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-8e332ebf-d30a-41ce-9cf8-dc4089c75f04 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:39.656821 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-8e332ebf-d30a-41ce-9cf8-dc4089c75f04 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08" status: 200 len: 1522 microversion: 2.1 time: 0.177054 May 31 21:04:39.657406 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 87/213] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:39 2022] GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:04:39.687516 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-f984488b-3ff0-4d19-a2fc-ac5d99922951 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:39.688203 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-f984488b-3ff0-4d19-a2fc-ac5d99922951 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:39.695825 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f984488b-3ff0-4d19-a2fc-ac5d99922951 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:39.696272 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f984488b-3ff0-4d19-a2fc-ac5d99922951 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:39.697110 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f984488b-3ff0-4d19-a2fc-ac5d99922951 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:39.698003 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f984488b-3ff0-4d19-a2fc-ac5d99922951 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:39.849057 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-f984488b-3ff0-4d19-a2fc-ac5d99922951 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:39.857297 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-f984488b-3ff0-4d19-a2fc-ac5d99922951 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1363 microversion: 2.1 time: 0.173938 May 31 21:04:39.857878 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 127/214] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:39 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:04:40.199419 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-9fc6b7b8-37a7-4def-8af7-0f3d8584dd9b tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:40.200055 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-9fc6b7b8-37a7-4def-8af7-0f3d8584dd9b tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:40.207082 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9fc6b7b8-37a7-4def-8af7-0f3d8584dd9b tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:40.207538 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9fc6b7b8-37a7-4def-8af7-0f3d8584dd9b tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:40.208322 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9fc6b7b8-37a7-4def-8af7-0f3d8584dd9b tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:40.208761 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9fc6b7b8-37a7-4def-8af7-0f3d8584dd9b tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:40.345125 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-9fc6b7b8-37a7-4def-8af7-0f3d8584dd9b tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:40.360025 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-9fc6b7b8-37a7-4def-8af7-0f3d8584dd9b tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:40.362290 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-9fc6b7b8-37a7-4def-8af7-0f3d8584dd9b tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:40.363015 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-9fc6b7b8-37a7-4def-8af7-0f3d8584dd9b tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1406 microversion: 2.20 time: 0.168232 May 31 21:04:40.363659 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 88/215] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:04:40 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:04:40.674580 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-4aabc9e5-f6a2-4b81-96b0-502110db4128 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:40.675196 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-4aabc9e5-f6a2-4b81-96b0-502110db4128 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 9bff085f-5477-4588-9e08-533189d2db08] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:40.681536 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4aabc9e5-f6a2-4b81-96b0-502110db4128 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:40.682023 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4aabc9e5-f6a2-4b81-96b0-502110db4128 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:40.682805 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4aabc9e5-f6a2-4b81-96b0-502110db4128 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:40.683244 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4aabc9e5-f6a2-4b81-96b0-502110db4128 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:40.822288 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-4aabc9e5-f6a2-4b81-96b0-502110db4128 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:40.830278 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-4aabc9e5-f6a2-4b81-96b0-502110db4128 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08" status: 200 len: 1522 microversion: 2.1 time: 0.159489 May 31 21:04:40.830853 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 128/216] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:40 2022] GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:04:40.875286 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-4f7e7d83-fb8c-47bf-877b-a2a57ed11df6 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:40.875888 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-4f7e7d83-fb8c-47bf-877b-a2a57ed11df6 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:40.882160 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4f7e7d83-fb8c-47bf-877b-a2a57ed11df6 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:40.882647 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4f7e7d83-fb8c-47bf-877b-a2a57ed11df6 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:40.883417 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4f7e7d83-fb8c-47bf-877b-a2a57ed11df6 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:40.883858 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4f7e7d83-fb8c-47bf-877b-a2a57ed11df6 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:41.016082 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-4f7e7d83-fb8c-47bf-877b-a2a57ed11df6 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:41.024128 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-4f7e7d83-fb8c-47bf-877b-a2a57ed11df6 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1363 microversion: 2.1 time: 0.152746 May 31 21:04:41.024704 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 89/217] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:40 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:04:41.383612 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-e188b13f-5a13-4571-95d6-8621d2e7d418 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:41.384138 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-e188b13f-5a13-4571-95d6-8621d2e7d418 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:41.390756 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e188b13f-5a13-4571-95d6-8621d2e7d418 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:41.391211 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e188b13f-5a13-4571-95d6-8621d2e7d418 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:41.391997 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e188b13f-5a13-4571-95d6-8621d2e7d418 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:41.392437 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e188b13f-5a13-4571-95d6-8621d2e7d418 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:41.549964 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-e188b13f-5a13-4571-95d6-8621d2e7d418 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:41.558772 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-e188b13f-5a13-4571-95d6-8621d2e7d418 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:41.560417 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-e188b13f-5a13-4571-95d6-8621d2e7d418 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:41.561543 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-e188b13f-5a13-4571-95d6-8621d2e7d418 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1406 microversion: 2.20 time: 0.182513 May 31 21:04:41.562136 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 129/218] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:04:41 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1406 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:04:41.847840 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-8ca62d14-afc8-40de-85bd-ccc892b21e60 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:41.848467 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-8ca62d14-afc8-40de-85bd-ccc892b21e60 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 9bff085f-5477-4588-9e08-533189d2db08] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:41.856775 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-8ca62d14-afc8-40de-85bd-ccc892b21e60 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:41.857234 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-8ca62d14-afc8-40de-85bd-ccc892b21e60 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:41.858180 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-8ca62d14-afc8-40de-85bd-ccc892b21e60 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:41.858902 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-8ca62d14-afc8-40de-85bd-ccc892b21e60 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:42.003426 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-8ca62d14-afc8-40de-85bd-ccc892b21e60 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:42.012006 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-8ca62d14-afc8-40de-85bd-ccc892b21e60 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08" status: 200 len: 1522 microversion: 2.1 time: 0.168046 May 31 21:04:42.012595 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 90/219] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:41 2022] GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:04:42.041765 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-4dbb96a0-6191-4568-8396-4b7ead4830bf tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:42.042342 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-4dbb96a0-6191-4568-8396-4b7ead4830bf tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:42.048445 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4dbb96a0-6191-4568-8396-4b7ead4830bf tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:42.048920 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4dbb96a0-6191-4568-8396-4b7ead4830bf tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:42.049711 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4dbb96a0-6191-4568-8396-4b7ead4830bf tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:42.050170 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4dbb96a0-6191-4568-8396-4b7ead4830bf tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:42.184546 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-4dbb96a0-6191-4568-8396-4b7ead4830bf tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:42.192093 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-4dbb96a0-6191-4568-8396-4b7ead4830bf tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1363 microversion: 2.1 time: 0.155033 May 31 21:04:42.192650 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 130/220] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:42 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:04:42.590548 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-94e7b543-8dac-40bf-b80d-dfa9f8b88d55 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:42.590548 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-94e7b543-8dac-40bf-b80d-dfa9f8b88d55 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:42.596543 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-94e7b543-8dac-40bf-b80d-dfa9f8b88d55 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:42.597024 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-94e7b543-8dac-40bf-b80d-dfa9f8b88d55 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:42.597955 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-94e7b543-8dac-40bf-b80d-dfa9f8b88d55 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:42.598400 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-94e7b543-8dac-40bf-b80d-dfa9f8b88d55 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:42.756136 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-94e7b543-8dac-40bf-b80d-dfa9f8b88d55 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:42.765156 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-94e7b543-8dac-40bf-b80d-dfa9f8b88d55 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:42.766797 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-94e7b543-8dac-40bf-b80d-dfa9f8b88d55 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:42.768815 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-94e7b543-8dac-40bf-b80d-dfa9f8b88d55 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1598 microversion: 2.20 time: 0.186625 May 31 21:04:42.769516 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 91/221] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:04:42 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1598 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:04:42.789291 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-d2f228a5-d62e-4a11-9e81-29906677f35e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:42.790438 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-d2f228a5-d62e-4a11-9e81-29906677f35e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:42.798497 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d2f228a5-d62e-4a11-9e81-29906677f35e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:42.799356 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d2f228a5-d62e-4a11-9e81-29906677f35e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:42.799913 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d2f228a5-d62e-4a11-9e81-29906677f35e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:42.800424 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d2f228a5-d62e-4a11-9e81-29906677f35e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:42.881464 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-d2f228a5-d62e-4a11-9e81-29906677f35e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.097870 May 31 21:04:42.882098 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 131/222] 10.222.0.55 () {60 vars in 1315 bytes} [Tue May 31 21:04:42 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 21:04:43.028662 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-ce1bd3d5-7809-4ab5-8364-3562d41bcea9 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:43.029331 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-ce1bd3d5-7809-4ab5-8364-3562d41bcea9 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 9bff085f-5477-4588-9e08-533189d2db08] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:43.036147 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ce1bd3d5-7809-4ab5-8364-3562d41bcea9 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:43.036720 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ce1bd3d5-7809-4ab5-8364-3562d41bcea9 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:43.037604 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ce1bd3d5-7809-4ab5-8364-3562d41bcea9 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:43.038179 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ce1bd3d5-7809-4ab5-8364-3562d41bcea9 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:43.209432 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-e67bd64c-5e4a-48a3-9c3d-97a3c57a4c4f tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:43.210183 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-e67bd64c-5e4a-48a3-9c3d-97a3c57a4c4f tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:43.216810 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e67bd64c-5e4a-48a3-9c3d-97a3c57a4c4f tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:43.218250 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e67bd64c-5e4a-48a3-9c3d-97a3c57a4c4f tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:43.218250 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e67bd64c-5e4a-48a3-9c3d-97a3c57a4c4f tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:43.218536 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e67bd64c-5e4a-48a3-9c3d-97a3c57a4c4f tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:43.548824 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-ce1bd3d5-7809-4ab5-8364-3562d41bcea9 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:43.566676 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-ce1bd3d5-7809-4ab5-8364-3562d41bcea9 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08" status: 200 len: 1522 microversion: 2.1 time: 0.541861 May 31 21:04:43.567497 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 92/223] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:43 2022] GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08 => generated 1522 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:04:43.798020 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-e67bd64c-5e4a-48a3-9c3d-97a3c57a4c4f tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:43.810920 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-e67bd64c-5e4a-48a3-9c3d-97a3c57a4c4f tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1363 microversion: 2.1 time: 0.605401 May 31 21:04:43.812608 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 132/224] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:43 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1363 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:04:44.599398 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-02dc3b2e-f453-424a-bc41-fd739b1400e6 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:44.604311 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-02dc3b2e-f453-424a-bc41-fd739b1400e6 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 9bff085f-5477-4588-9e08-533189d2db08] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:44.626438 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-02dc3b2e-f453-424a-bc41-fd739b1400e6 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:44.626438 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-02dc3b2e-f453-424a-bc41-fd739b1400e6 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:44.626438 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-02dc3b2e-f453-424a-bc41-fd739b1400e6 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:44.628092 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-02dc3b2e-f453-424a-bc41-fd739b1400e6 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:44.831614 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-e8f6b449-c578-4bc3-a7f8-1ce1938fafc6 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:44.832231 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-e8f6b449-c578-4bc3-a7f8-1ce1938fafc6 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:44.846452 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e8f6b449-c578-4bc3-a7f8-1ce1938fafc6 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:44.858341 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e8f6b449-c578-4bc3-a7f8-1ce1938fafc6 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:44.858341 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e8f6b449-c578-4bc3-a7f8-1ce1938fafc6 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:44.858341 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e8f6b449-c578-4bc3-a7f8-1ce1938fafc6 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:44.918301 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-02dc3b2e-f453-424a-bc41-fd739b1400e6 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:44.926206 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-02dc3b2e-f453-424a-bc41-fd739b1400e6 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08" status: 200 len: 1522 microversion: 2.1 time: 0.341360 May 31 21:04:44.926796 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 93/225] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:44 2022] GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08 => generated 1522 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:04:44.940294 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [req-5f46baea-173f-4fcb-9da9-b4d583ee6655 req-a6235532-8085-4a4f-80fe-9b8528cd72d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a123764b-4693-41b1-bad8-a1a63cc951cd", "tag": "cc0edf95-fc02-451a-b38f-075bee275ed6"}]} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:04:44.957378 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-5f46baea-173f-4fcb-9da9-b4d583ee6655 req-a6235532-8085-4a4f-80fe-9b8528cd72d3 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:44.958184 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-5f46baea-173f-4fcb-9da9-b4d583ee6655 req-a6235532-8085-4a4f-80fe-9b8528cd72d3 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:44.984052 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.compute.server_external_events [req-5f46baea-173f-4fcb-9da9-b4d583ee6655 req-a6235532-8085-4a4f-80fe-9b8528cd72d3 service nova] Creating event network-changed:cc0edf95-fc02-451a-b38f-075bee275ed6 for instance a123764b-4693-41b1-bad8-a1a63cc951cd on hv-cinder-83979 May 31 21:04:44.996246 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [req-5f46baea-173f-4fcb-9da9-b4d583ee6655 req-a6235532-8085-4a4f-80fe-9b8528cd72d3 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067895 May 31 21:04:44.996714 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 94/226] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:04:45.064027 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-e8f6b449-c578-4bc3-a7f8-1ce1938fafc6 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:45.082649 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-e8f6b449-c578-4bc3-a7f8-1ce1938fafc6 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1363 microversion: 2.1 time: 0.256305 May 31 21:04:45.083235 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 133/227] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:44 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1363 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:04:45.944332 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-e6312930-b9ac-4ba4-9385-f953abb9db43 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:45.946329 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-e6312930-b9ac-4ba4-9385-f953abb9db43 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 9bff085f-5477-4588-9e08-533189d2db08] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:45.955567 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e6312930-b9ac-4ba4-9385-f953abb9db43 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:45.956271 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e6312930-b9ac-4ba4-9385-f953abb9db43 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:45.957223 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e6312930-b9ac-4ba4-9385-f953abb9db43 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:45.957811 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e6312930-b9ac-4ba4-9385-f953abb9db43 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:46.100309 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-d2c21474-c728-4686-9912-1137f31cc535 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:46.100988 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-d2c21474-c728-4686-9912-1137f31cc535 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:46.110712 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d2c21474-c728-4686-9912-1137f31cc535 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:46.111277 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d2c21474-c728-4686-9912-1137f31cc535 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:46.112891 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d2c21474-c728-4686-9912-1137f31cc535 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:46.113649 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d2c21474-c728-4686-9912-1137f31cc535 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:46.360583 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-e6312930-b9ac-4ba4-9385-f953abb9db43 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:46.383225 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-e6312930-b9ac-4ba4-9385-f953abb9db43 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08" status: 200 len: 1522 microversion: 2.1 time: 0.433193 May 31 21:04:46.383225 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 95/228] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:45 2022] GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08 => generated 1522 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:04:46.418744 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-d2c21474-c728-4686-9912-1137f31cc535 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:46.432859 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-d2c21474-c728-4686-9912-1137f31cc535 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1548 microversion: 2.1 time: 0.336751 May 31 21:04:46.433477 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 134/229] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:46 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1548 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:04:46.458524 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-be8f9c8a-76f9-4100-949a-0554b1fc3eb3 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:46.459862 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-be8f9c8a-76f9-4100-949a-0554b1fc3eb3 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:46.469055 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-be8f9c8a-76f9-4100-949a-0554b1fc3eb3 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:46.471685 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-be8f9c8a-76f9-4100-949a-0554b1fc3eb3 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:46.476120 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-be8f9c8a-76f9-4100-949a-0554b1fc3eb3 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:46.476120 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-be8f9c8a-76f9-4100-949a-0554b1fc3eb3 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:46.618357 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-be8f9c8a-76f9-4100-949a-0554b1fc3eb3 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.168847 May 31 21:04:46.619101 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 96/230] 10.222.0.55 () {58 vars in 1274 bytes} [Tue May 31 21:04:46 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014/os-interface => generated 284 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:04:47.394322 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-378ea8af-acd9-4778-a25a-ff0278ca7381 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:47.395902 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-378ea8af-acd9-4778-a25a-ff0278ca7381 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 9bff085f-5477-4588-9e08-533189d2db08] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:47.408544 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-378ea8af-acd9-4778-a25a-ff0278ca7381 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:47.409232 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-378ea8af-acd9-4778-a25a-ff0278ca7381 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:47.410384 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-378ea8af-acd9-4778-a25a-ff0278ca7381 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:47.411035 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-378ea8af-acd9-4778-a25a-ff0278ca7381 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:47.636958 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-378ea8af-acd9-4778-a25a-ff0278ca7381 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:47.642409 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:47.647330 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-378ea8af-acd9-4778-a25a-ff0278ca7381 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08" status: 200 len: 1522 microversion: 2.1 time: 0.257634 May 31 21:04:47.649122 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 135/231] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:47 2022] GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08 => generated 1522 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:04:48.364744 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [req-0c35a1fa-2429-4072-ace5-c84ddbbba139 req-0e350eb0-c9c4-45ba-b4c9-c987baa9b537 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "faf12fce-2352-40df-a297-0d7b28379014", "tag": "eb53f5b6-46bd-4009-8d09-18c62dd763ce"}]} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:04:48.389729 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-0c35a1fa-2429-4072-ace5-c84ddbbba139 req-0e350eb0-c9c4-45ba-b4c9-c987baa9b537 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:48.390205 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-0c35a1fa-2429-4072-ace5-c84ddbbba139 req-0e350eb0-c9c4-45ba-b4c9-c987baa9b537 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:48.394518 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:48.422878 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.compute.server_external_events [req-0c35a1fa-2429-4072-ace5-c84ddbbba139 req-0e350eb0-c9c4-45ba-b4c9-c987baa9b537 service nova] Creating event network-changed:eb53f5b6-46bd-4009-8d09-18c62dd763ce for instance faf12fce-2352-40df-a297-0d7b28379014 on hv-cinder-83979 May 31 21:04:48.428129 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [req-0c35a1fa-2429-4072-ace5-c84ddbbba139 req-0e350eb0-c9c4-45ba-b4c9-c987baa9b537 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067722 May 31 21:04:48.429325 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 97/232] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 21:04:48.678102 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-d8210f01-c31d-4468-9b0e-15a913e67ebe tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:48.680659 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-d8210f01-c31d-4468-9b0e-15a913e67ebe tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 9bff085f-5477-4588-9e08-533189d2db08] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:48.714350 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d8210f01-c31d-4468-9b0e-15a913e67ebe tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:48.714884 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d8210f01-c31d-4468-9b0e-15a913e67ebe tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:48.715722 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d8210f01-c31d-4468-9b0e-15a913e67ebe tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:48.716150 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d8210f01-c31d-4468-9b0e-15a913e67ebe tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:48.997528 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-d8210f01-c31d-4468-9b0e-15a913e67ebe tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:49.010465 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-d8210f01-c31d-4468-9b0e-15a913e67ebe tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08" status: 200 len: 1522 microversion: 2.1 time: 0.344517 May 31 21:04:49.015364 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 136/233] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:48 2022] GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08 => generated 1522 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:04:50.034129 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-d7151e35-04d3-48f2-80d9-59108f0401da tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:50.034675 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-d7151e35-04d3-48f2-80d9-59108f0401da tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 9bff085f-5477-4588-9e08-533189d2db08] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:50.042935 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-d7151e35-04d3-48f2-80d9-59108f0401da tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:50.043387 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-d7151e35-04d3-48f2-80d9-59108f0401da tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:50.044257 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-d7151e35-04d3-48f2-80d9-59108f0401da tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:50.044612 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-d7151e35-04d3-48f2-80d9-59108f0401da tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:50.223646 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-d7151e35-04d3-48f2-80d9-59108f0401da tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:50.251126 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-d7151e35-04d3-48f2-80d9-59108f0401da tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08" status: 200 len: 1522 microversion: 2.1 time: 0.216602 May 31 21:04:50.251126 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 98/234] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:50 2022] GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:04:51.263189 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-26c232c6-f45e-428f-822d-8c871ebaca4e tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:51.263807 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-26c232c6-f45e-428f-822d-8c871ebaca4e tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 9bff085f-5477-4588-9e08-533189d2db08] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:51.270946 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-26c232c6-f45e-428f-822d-8c871ebaca4e tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:51.272538 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-26c232c6-f45e-428f-822d-8c871ebaca4e tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:51.272538 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-26c232c6-f45e-428f-822d-8c871ebaca4e tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:51.272713 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-26c232c6-f45e-428f-822d-8c871ebaca4e tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:51.526995 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-26c232c6-f45e-428f-822d-8c871ebaca4e tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:51.536331 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-26c232c6-f45e-428f-822d-8c871ebaca4e tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08" status: 200 len: 1522 microversion: 2.1 time: 0.277003 May 31 21:04:51.537690 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 137/235] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:51 2022] GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08 => generated 1522 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:04:52.556357 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-dc4a07a2-79b7-483f-9624-03ab9f4893c0 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:52.557521 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-dc4a07a2-79b7-483f-9624-03ab9f4893c0 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 9bff085f-5477-4588-9e08-533189d2db08] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:52.564601 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-dc4a07a2-79b7-483f-9624-03ab9f4893c0 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:52.565064 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-dc4a07a2-79b7-483f-9624-03ab9f4893c0 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:52.565886 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-dc4a07a2-79b7-483f-9624-03ab9f4893c0 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:52.566384 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-dc4a07a2-79b7-483f-9624-03ab9f4893c0 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:52.756763 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-dc4a07a2-79b7-483f-9624-03ab9f4893c0 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:52.767215 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-dc4a07a2-79b7-483f-9624-03ab9f4893c0 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08" status: 200 len: 1522 microversion: 2.1 time: 0.216434 May 31 21:04:52.768680 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 99/236] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:52 2022] GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:04:53.184811 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-72f7a515-3cf0-49f8-9736-4150001f38bc tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:53.185635 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-72f7a515-3cf0-49f8-9736-4150001f38bc tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] [instance: 35c086d9-50bf-494a-90bb-694569f861a8] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:53.192129 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-72f7a515-3cf0-49f8-9736-4150001f38bc tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:53.192583 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-72f7a515-3cf0-49f8-9736-4150001f38bc tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:53.193374 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-72f7a515-3cf0-49f8-9736-4150001f38bc tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:53.193813 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-72f7a515-3cf0-49f8-9736-4150001f38bc tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:53.222173 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-72f7a515-3cf0-49f8-9736-4150001f38bc tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] [instance: 35c086d9-50bf-494a-90bb-694569f861a8] Going to try to terminate instance {{(pid=118184) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 21:04:53.641013 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-72f7a515-3cf0-49f8-9736-4150001f38bc tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] 10.222.0.55 "DELETE /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8" status: 204 len: 0 microversion: 2.1 time: 0.460191 May 31 21:04:53.650783 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 138/237] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 31 21:04:53 2022] DELETE /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 31 21:04:53.665283 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-2903cf3d-7d0a-4d21-9b03-7ff3c376505e tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:53.665990 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-2903cf3d-7d0a-4d21-9b03-7ff3c376505e tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] [instance: 35c086d9-50bf-494a-90bb-694569f861a8] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:53.679449 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-2903cf3d-7d0a-4d21-9b03-7ff3c376505e tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:53.679449 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-2903cf3d-7d0a-4d21-9b03-7ff3c376505e tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:53.679449 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-2903cf3d-7d0a-4d21-9b03-7ff3c376505e tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:53.679449 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-2903cf3d-7d0a-4d21-9b03-7ff3c376505e tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:53.822005 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-12f6458d-a12b-4bda-95a5-2a24ab30109e tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:53.838414 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-12f6458d-a12b-4bda-95a5-2a24ab30109e tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 9bff085f-5477-4588-9e08-533189d2db08] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:53.861566 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-12f6458d-a12b-4bda-95a5-2a24ab30109e tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:53.862842 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-12f6458d-a12b-4bda-95a5-2a24ab30109e tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:53.864645 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-12f6458d-a12b-4bda-95a5-2a24ab30109e tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:53.865343 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-12f6458d-a12b-4bda-95a5-2a24ab30109e tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:53.917102 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-2903cf3d-7d0a-4d21-9b03-7ff3c376505e tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b358c38b5a44d798f7f53c4b318134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f91ac37f864ed98a03f9082252e334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:53.938920 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-2903cf3d-7d0a-4d21-9b03-7ff3c376505e tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] 10.222.0.55 "GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8" status: 200 len: 1554 microversion: 2.1 time: 0.268472 May 31 21:04:53.938920 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 100/238] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:53 2022] GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8 => generated 1554 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:04:54.075691 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-12f6458d-a12b-4bda-95a5-2a24ab30109e tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:54.094586 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-12f6458d-a12b-4bda-95a5-2a24ab30109e tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08" status: 200 len: 1522 microversion: 2.1 time: 0.287070 May 31 21:04:54.097289 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 139/239] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:53 2022] GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08 => generated 1522 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:04:54.948370 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-6665e24f-d0da-47a4-9b23-88d10e88c3e7 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:54.949028 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-6665e24f-d0da-47a4-9b23-88d10e88c3e7 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] [instance: 35c086d9-50bf-494a-90bb-694569f861a8] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:54.962751 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-6665e24f-d0da-47a4-9b23-88d10e88c3e7 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:54.963230 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-6665e24f-d0da-47a4-9b23-88d10e88c3e7 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:54.964290 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-6665e24f-d0da-47a4-9b23-88d10e88c3e7 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:54.964891 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-6665e24f-d0da-47a4-9b23-88d10e88c3e7 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:55.124198 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-92bd7660-c647-4d72-82b7-6b18591bb709 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:55.125013 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-92bd7660-c647-4d72-82b7-6b18591bb709 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 9bff085f-5477-4588-9e08-533189d2db08] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:55.140998 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-92bd7660-c647-4d72-82b7-6b18591bb709 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:55.142267 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-92bd7660-c647-4d72-82b7-6b18591bb709 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:55.146972 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-92bd7660-c647-4d72-82b7-6b18591bb709 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:55.147891 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-92bd7660-c647-4d72-82b7-6b18591bb709 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:55.436235 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-6665e24f-d0da-47a4-9b23-88d10e88c3e7 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b358c38b5a44d798f7f53c4b318134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f91ac37f864ed98a03f9082252e334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:55.444939 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-6665e24f-d0da-47a4-9b23-88d10e88c3e7 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] 10.222.0.55 "GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8" status: 200 len: 1554 microversion: 2.1 time: 0.501455 May 31 21:04:55.446188 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 101/240] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:54 2022] GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8 => generated 1554 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:04:55.505943 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-92bd7660-c647-4d72-82b7-6b18591bb709 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:55.516171 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-92bd7660-c647-4d72-82b7-6b18591bb709 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08" status: 200 len: 1522 microversion: 2.1 time: 0.396124 May 31 21:04:55.521701 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 140/241] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:55 2022] GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08 => generated 1522 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:04:56.484700 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-fd69bf7b-5a63-4bc3-911d-5f930b59dbd4 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:56.488029 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-fd69bf7b-5a63-4bc3-911d-5f930b59dbd4 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] [instance: 35c086d9-50bf-494a-90bb-694569f861a8] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:56.498241 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-fd69bf7b-5a63-4bc3-911d-5f930b59dbd4 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:56.498973 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-fd69bf7b-5a63-4bc3-911d-5f930b59dbd4 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:56.499489 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-fd69bf7b-5a63-4bc3-911d-5f930b59dbd4 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:56.499933 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-fd69bf7b-5a63-4bc3-911d-5f930b59dbd4 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:56.548236 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-6f4aa157-f1c2-4d86-81ad-8989ad85ed4c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:56.551527 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-6f4aa157-f1c2-4d86-81ad-8989ad85ed4c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 9bff085f-5477-4588-9e08-533189d2db08] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:56.583344 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6f4aa157-f1c2-4d86-81ad-8989ad85ed4c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:56.584013 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6f4aa157-f1c2-4d86-81ad-8989ad85ed4c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:56.590039 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6f4aa157-f1c2-4d86-81ad-8989ad85ed4c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:56.591218 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6f4aa157-f1c2-4d86-81ad-8989ad85ed4c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:57.080702 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-fd69bf7b-5a63-4bc3-911d-5f930b59dbd4 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b358c38b5a44d798f7f53c4b318134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f91ac37f864ed98a03f9082252e334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:57.089287 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-fd69bf7b-5a63-4bc3-911d-5f930b59dbd4 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] 10.222.0.55 "GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8" status: 200 len: 1554 microversion: 2.1 time: 0.616883 May 31 21:04:57.090789 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 102/242] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:56 2022] GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8 => generated 1554 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:04:57.131021 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-6f4aa157-f1c2-4d86-81ad-8989ad85ed4c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:57.140938 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-6f4aa157-f1c2-4d86-81ad-8989ad85ed4c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08" status: 200 len: 1522 microversion: 2.1 time: 0.602890 May 31 21:04:57.141701 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 141/243] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:56 2022] GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08 => generated 1522 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:04:58.107772 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-5a8a5804-4b39-417b-9020-114873f62832 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:58.109142 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-5a8a5804-4b39-417b-9020-114873f62832 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] [instance: 35c086d9-50bf-494a-90bb-694569f861a8] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:58.112237 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_api:SELECT=45 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:58.118552 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-5a8a5804-4b39-417b-9020-114873f62832 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:58.119084 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-5a8a5804-4b39-417b-9020-114873f62832 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:58.119965 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-5a8a5804-4b39-417b-9020-114873f62832 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:58.120492 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-5a8a5804-4b39-417b-9020-114873f62832 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:58.164499 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-2c443080-510f-4154-934c-346c5f026f37 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:58.165366 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-2c443080-510f-4154-934c-346c5f026f37 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 9bff085f-5477-4588-9e08-533189d2db08] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:58.206472 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2c443080-510f-4154-934c-346c5f026f37 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:58.206956 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2c443080-510f-4154-934c-346c5f026f37 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:58.207828 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2c443080-510f-4154-934c-346c5f026f37 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:58.212895 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2c443080-510f-4154-934c-346c5f026f37 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:58.417290 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-5a8a5804-4b39-417b-9020-114873f62832 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b358c38b5a44d798f7f53c4b318134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f91ac37f864ed98a03f9082252e334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:58.439531 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-5a8a5804-4b39-417b-9020-114873f62832 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] 10.222.0.55 "GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8" status: 200 len: 1554 microversion: 2.1 time: 0.335740 May 31 21:04:58.448372 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 103/244] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:58 2022] GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8 => generated 1554 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:04:58.525622 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-2c443080-510f-4154-934c-346c5f026f37 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:58.540885 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-2c443080-510f-4154-934c-346c5f026f37 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08" status: 200 len: 1522 microversion: 2.1 time: 0.385459 May 31 21:04:58.542385 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 142/245] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:58 2022] GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08 => generated 1522 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:04:59.468466 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-3bec6ea6-6c16-438b-841c-906b81be67ee tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:59.468466 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-3bec6ea6-6c16-438b-841c-906b81be67ee tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] [instance: 35c086d9-50bf-494a-90bb-694569f861a8] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:59.474991 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-3bec6ea6-6c16-438b-841c-906b81be67ee tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:59.475440 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-3bec6ea6-6c16-438b-841c-906b81be67ee tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:59.476309 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-3bec6ea6-6c16-438b-841c-906b81be67ee tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:59.476750 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-3bec6ea6-6c16-438b-841c-906b81be67ee tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:59.560136 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-95df6371-c32c-4aa3-a0ad-fb6b21446455 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:04:59.562068 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-95df6371-c32c-4aa3-a0ad-fb6b21446455 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 9bff085f-5477-4588-9e08-533189d2db08] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:04:59.569092 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-95df6371-c32c-4aa3-a0ad-fb6b21446455 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:59.569550 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-95df6371-c32c-4aa3-a0ad-fb6b21446455 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:59.571618 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-95df6371-c32c-4aa3-a0ad-fb6b21446455 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:04:59.571618 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-95df6371-c32c-4aa3-a0ad-fb6b21446455 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:04:59.667089 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-3bec6ea6-6c16-438b-841c-906b81be67ee tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b358c38b5a44d798f7f53c4b318134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f91ac37f864ed98a03f9082252e334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:59.681477 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-3bec6ea6-6c16-438b-841c-906b81be67ee tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] 10.222.0.55 "GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8" status: 200 len: 1554 microversion: 2.1 time: 0.222516 May 31 21:04:59.682431 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 104/246] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:59 2022] GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8 => generated 1554 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:04:59.809584 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-95df6371-c32c-4aa3-a0ad-fb6b21446455 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:04:59.825602 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-95df6371-c32c-4aa3-a0ad-fb6b21446455 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08" status: 200 len: 1522 microversion: 2.1 time: 0.269567 May 31 21:04:59.825602 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 143/247] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:04:59 2022] GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08 => generated 1522 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:05:00.698396 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-c21143a2-73e9-4bcf-838b-1d3c69f85626 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:05:00.698998 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-c21143a2-73e9-4bcf-838b-1d3c69f85626 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] [instance: 35c086d9-50bf-494a-90bb-694569f861a8] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:05:00.706279 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c21143a2-73e9-4bcf-838b-1d3c69f85626 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:00.706738 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c21143a2-73e9-4bcf-838b-1d3c69f85626 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:00.707560 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c21143a2-73e9-4bcf-838b-1d3c69f85626 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:00.708000 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c21143a2-73e9-4bcf-838b-1d3c69f85626 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:00.857936 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-2c86c1b6-28b7-41ce-99b2-e3fb837e8815 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:05:00.859054 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-2c86c1b6-28b7-41ce-99b2-e3fb837e8815 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 9bff085f-5477-4588-9e08-533189d2db08] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:05:00.873752 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2c86c1b6-28b7-41ce-99b2-e3fb837e8815 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:00.874957 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2c86c1b6-28b7-41ce-99b2-e3fb837e8815 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:00.876872 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2c86c1b6-28b7-41ce-99b2-e3fb837e8815 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:00.878039 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2c86c1b6-28b7-41ce-99b2-e3fb837e8815 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:00.895791 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-c21143a2-73e9-4bcf-838b-1d3c69f85626 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b358c38b5a44d798f7f53c4b318134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f91ac37f864ed98a03f9082252e334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:05:00.905043 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-c21143a2-73e9-4bcf-838b-1d3c69f85626 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] 10.222.0.55 "GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8" status: 200 len: 1554 microversion: 2.1 time: 0.210470 May 31 21:05:00.905643 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 105/248] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:05:00 2022] GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8 => generated 1554 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:05:01.069326 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-2c86c1b6-28b7-41ce-99b2-e3fb837e8815 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:05:01.081525 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-2c86c1b6-28b7-41ce-99b2-e3fb837e8815 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08" status: 200 len: 1522 microversion: 2.1 time: 0.233340 May 31 21:05:01.082762 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 144/249] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:05:00 2022] GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:05:01.928546 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-9622b659-079f-4f18-9da5-0ae391bf6dec tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:05:01.933091 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-9622b659-079f-4f18-9da5-0ae391bf6dec tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] [instance: 35c086d9-50bf-494a-90bb-694569f861a8] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:05:01.947208 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9622b659-079f-4f18-9da5-0ae391bf6dec tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:01.951100 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9622b659-079f-4f18-9da5-0ae391bf6dec tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:01.953093 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9622b659-079f-4f18-9da5-0ae391bf6dec tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:01.954111 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9622b659-079f-4f18-9da5-0ae391bf6dec tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:02.103269 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-58d339ab-bdfa-4293-8f4b-f26c8c2cb33b tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:05:02.104173 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-58d339ab-bdfa-4293-8f4b-f26c8c2cb33b tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 9bff085f-5477-4588-9e08-533189d2db08] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:05:02.115102 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-58d339ab-bdfa-4293-8f4b-f26c8c2cb33b tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:02.119127 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-58d339ab-bdfa-4293-8f4b-f26c8c2cb33b tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:02.119988 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-58d339ab-bdfa-4293-8f4b-f26c8c2cb33b tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:02.120620 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-58d339ab-bdfa-4293-8f4b-f26c8c2cb33b tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:02.484014 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-9622b659-079f-4f18-9da5-0ae391bf6dec tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b358c38b5a44d798f7f53c4b318134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f91ac37f864ed98a03f9082252e334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:05:02.514621 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-9622b659-079f-4f18-9da5-0ae391bf6dec tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] 10.222.0.55 "GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8" status: 200 len: 1554 microversion: 2.1 time: 0.590965 May 31 21:05:02.530301 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 106/250] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:05:01 2022] GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8 => generated 1554 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:05:02.561503 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-58d339ab-bdfa-4293-8f4b-f26c8c2cb33b tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:05:02.583116 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-58d339ab-bdfa-4293-8f4b-f26c8c2cb33b tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08" status: 200 len: 1522 microversion: 2.1 time: 0.481668 May 31 21:05:02.584612 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 145/251] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:05:02 2022] GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08 => generated 1522 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:05:03.563291 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-efa37380-ac45-45dc-b3b4-1a6b1c9686ed tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:05:03.564196 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-efa37380-ac45-45dc-b3b4-1a6b1c9686ed tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] [instance: 35c086d9-50bf-494a-90bb-694569f861a8] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:05:03.601446 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-efa37380-ac45-45dc-b3b4-1a6b1c9686ed tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:03.602758 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-efa37380-ac45-45dc-b3b4-1a6b1c9686ed tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:03.609044 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-25c60dcb-ec0c-4ba3-a107-4c140178f8c9 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:05:03.609971 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-25c60dcb-ec0c-4ba3-a107-4c140178f8c9 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 9bff085f-5477-4588-9e08-533189d2db08] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:05:03.611081 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-efa37380-ac45-45dc-b3b4-1a6b1c9686ed tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:03.611721 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-efa37380-ac45-45dc-b3b4-1a6b1c9686ed tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:03.626340 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-25c60dcb-ec0c-4ba3-a107-4c140178f8c9 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:03.627430 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-25c60dcb-ec0c-4ba3-a107-4c140178f8c9 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:03.630855 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-25c60dcb-ec0c-4ba3-a107-4c140178f8c9 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:03.632494 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-25c60dcb-ec0c-4ba3-a107-4c140178f8c9 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:03.895304 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-efa37380-ac45-45dc-b3b4-1a6b1c9686ed tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b358c38b5a44d798f7f53c4b318134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f91ac37f864ed98a03f9082252e334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:05:03.913530 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-efa37380-ac45-45dc-b3b4-1a6b1c9686ed tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] 10.222.0.55 "GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8" status: 200 len: 1512 microversion: 2.1 time: 0.378705 May 31 21:05:03.918020 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 107/252] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:05:03 2022] GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8 => generated 1512 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:05:03.926033 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [req-028f9b74-2617-4d3d-b10f-e17c1b3d101e req-abfa16c0-7e1a-4d47-adfc-919f56d1fbfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35c086d9-50bf-494a-90bb-694569f861a8", "name": "network-vif-deleted", "tag": "837c9641-8167-4561-b45f-1b48acf21abc"}]} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:05:03.938246 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-028f9b74-2617-4d3d-b10f-e17c1b3d101e req-abfa16c0-7e1a-4d47-adfc-919f56d1fbfd service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:03.938948 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-028f9b74-2617-4d3d-b10f-e17c1b3d101e req-abfa16c0-7e1a-4d47-adfc-919f56d1fbfd service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:03.961243 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.compute.server_external_events [req-028f9b74-2617-4d3d-b10f-e17c1b3d101e req-abfa16c0-7e1a-4d47-adfc-919f56d1fbfd service nova] Creating event network-vif-deleted:837c9641-8167-4561-b45f-1b48acf21abc for instance 35c086d9-50bf-494a-90bb-694569f861a8 on hv-cinder-83979 May 31 21:05:03.971639 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [req-028f9b74-2617-4d3d-b10f-e17c1b3d101e req-abfa16c0-7e1a-4d47-adfc-919f56d1fbfd service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051065 May 31 21:05:03.990385 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 108/253] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:05:04.196963 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-25c60dcb-ec0c-4ba3-a107-4c140178f8c9 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:05:04.209578 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-25c60dcb-ec0c-4ba3-a107-4c140178f8c9 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08" status: 200 len: 1522 microversion: 2.1 time: 0.611619 May 31 21:05:04.210226 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 146/254] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:05:03 2022] GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08 => generated 1522 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:05:04.936676 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-5ba4fd60-e380-4426-9961-8894d5520742 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:05:04.938287 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-5ba4fd60-e380-4426-9961-8894d5520742 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] [instance: 35c086d9-50bf-494a-90bb-694569f861a8] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:05:04.947038 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-5ba4fd60-e380-4426-9961-8894d5520742 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:04.947492 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-5ba4fd60-e380-4426-9961-8894d5520742 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:04.948304 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-5ba4fd60-e380-4426-9961-8894d5520742 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:04.948751 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-5ba4fd60-e380-4426-9961-8894d5520742 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:05.099008 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-5ba4fd60-e380-4426-9961-8894d5520742 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b358c38b5a44d798f7f53c4b318134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f91ac37f864ed98a03f9082252e334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:05:05.116315 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-5ba4fd60-e380-4426-9961-8894d5520742 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] 10.222.0.55 "GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8" status: 200 len: 1346 microversion: 2.1 time: 0.187519 May 31 21:05:05.131987 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 109/255] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:05:04 2022] GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8 => generated 1346 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:05:05.231371 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-e679fce6-193b-4681-845b-603cb75a4156 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:05:05.232407 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-e679fce6-193b-4681-845b-603cb75a4156 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 9bff085f-5477-4588-9e08-533189d2db08] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:05:05.236868 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:05.241310 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e679fce6-193b-4681-845b-603cb75a4156 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:05.242128 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e679fce6-193b-4681-845b-603cb75a4156 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:05.243937 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e679fce6-193b-4681-845b-603cb75a4156 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:05.244567 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e679fce6-193b-4681-845b-603cb75a4156 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:05.868588 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-e679fce6-193b-4681-845b-603cb75a4156 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:05:05.911255 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-e679fce6-193b-4681-845b-603cb75a4156 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08" status: 200 len: 1522 microversion: 2.1 time: 0.682631 May 31 21:05:05.914397 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 147/256] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:05:05 2022] GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08 => generated 1522 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:05:06.140668 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-031d0d51-d7fe-4ccf-9b51-4e57d854437f tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:05:06.142094 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-031d0d51-d7fe-4ccf-9b51-4e57d854437f tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] [instance: 35c086d9-50bf-494a-90bb-694569f861a8] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:05:06.155144 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-031d0d51-d7fe-4ccf-9b51-4e57d854437f tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:06.158769 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-031d0d51-d7fe-4ccf-9b51-4e57d854437f tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:06.160105 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-031d0d51-d7fe-4ccf-9b51-4e57d854437f tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:06.163382 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-031d0d51-d7fe-4ccf-9b51-4e57d854437f tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:06.247522 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-031d0d51-d7fe-4ccf-9b51-4e57d854437f tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:06.248262 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-031d0d51-d7fe-4ccf-9b51-4e57d854437f tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:06.249332 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.objects.instance [None req-031d0d51-d7fe-4ccf-9b51-4e57d854437f tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lazy-loading 'fault' on Instance uuid 35c086d9-50bf-494a-90bb-694569f861a8 {{(pid=118185) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 21:05:06.339990 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-031d0d51-d7fe-4ccf-9b51-4e57d854437f tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b358c38b5a44d798f7f53c4b318134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f91ac37f864ed98a03f9082252e334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:05:06.352546 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-031d0d51-d7fe-4ccf-9b51-4e57d854437f tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] 10.222.0.55 "GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8" status: 200 len: 1351 microversion: 2.1 time: 0.215518 May 31 21:05:06.354140 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 110/257] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:05:06 2022] GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8 => generated 1351 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:05:06.936492 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-b79e039e-b186-493d-9f7b-bede00528a7e tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:05:06.937780 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-b79e039e-b186-493d-9f7b-bede00528a7e tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 9bff085f-5477-4588-9e08-533189d2db08] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:05:06.947076 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b79e039e-b186-493d-9f7b-bede00528a7e tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:06.947547 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b79e039e-b186-493d-9f7b-bede00528a7e tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:06.948352 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b79e039e-b186-493d-9f7b-bede00528a7e tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:06.948788 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b79e039e-b186-493d-9f7b-bede00528a7e tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:07.109738 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-b79e039e-b186-493d-9f7b-bede00528a7e tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:05:07.120766 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-b79e039e-b186-493d-9f7b-bede00528a7e tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08" status: 200 len: 1522 microversion: 2.1 time: 0.193834 May 31 21:05:07.121440 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 148/258] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:05:06 2022] GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:05:07.376819 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-7432cc10-6d0a-499a-a472-4acb8b57bded tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:05:07.379342 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-7432cc10-6d0a-499a-a472-4acb8b57bded tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] [instance: 35c086d9-50bf-494a-90bb-694569f861a8] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:05:07.388494 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-7432cc10-6d0a-499a-a472-4acb8b57bded tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:07.389213 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-7432cc10-6d0a-499a-a472-4acb8b57bded tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:07.390251 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-7432cc10-6d0a-499a-a472-4acb8b57bded tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:07.391045 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-7432cc10-6d0a-499a-a472-4acb8b57bded tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:07.511186 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-7432cc10-6d0a-499a-a472-4acb8b57bded tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:07.511662 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-7432cc10-6d0a-499a-a472-4acb8b57bded tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:07.512135 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.objects.instance [None req-7432cc10-6d0a-499a-a472-4acb8b57bded tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lazy-loading 'fault' on Instance uuid 35c086d9-50bf-494a-90bb-694569f861a8 {{(pid=118185) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 21:05:07.620119 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-7432cc10-6d0a-499a-a472-4acb8b57bded tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b358c38b5a44d798f7f53c4b318134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f91ac37f864ed98a03f9082252e334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:05:07.634619 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-7432cc10-6d0a-499a-a472-4acb8b57bded tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] 10.222.0.55 "GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8" status: 200 len: 1351 microversion: 2.1 time: 0.263615 May 31 21:05:07.637075 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 111/259] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:05:07 2022] GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8 => generated 1351 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:05:08.143066 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-e1a0bee1-6e42-4eef-91aa-0ec46c3af0cd tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:05:08.144448 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-e1a0bee1-6e42-4eef-91aa-0ec46c3af0cd tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 9bff085f-5477-4588-9e08-533189d2db08] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:05:08.153822 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e1a0bee1-6e42-4eef-91aa-0ec46c3af0cd tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:08.154586 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e1a0bee1-6e42-4eef-91aa-0ec46c3af0cd tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:08.156853 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e1a0bee1-6e42-4eef-91aa-0ec46c3af0cd tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:08.157754 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e1a0bee1-6e42-4eef-91aa-0ec46c3af0cd tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:08.379262 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-e1a0bee1-6e42-4eef-91aa-0ec46c3af0cd tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:05:08.395789 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-e1a0bee1-6e42-4eef-91aa-0ec46c3af0cd tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08" status: 200 len: 1522 microversion: 2.1 time: 0.259927 May 31 21:05:08.397421 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 149/260] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:05:08 2022] GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08 => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:05:08.672833 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-6eacfd71-ff0f-429b-adcd-f2d5f2fb17ca tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:05:08.673477 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-6eacfd71-ff0f-429b-adcd-f2d5f2fb17ca tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] [instance: 35c086d9-50bf-494a-90bb-694569f861a8] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:05:08.690114 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-6eacfd71-ff0f-429b-adcd-f2d5f2fb17ca tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:08.690945 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-6eacfd71-ff0f-429b-adcd-f2d5f2fb17ca tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:08.693442 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-6eacfd71-ff0f-429b-adcd-f2d5f2fb17ca tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:08.694531 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-6eacfd71-ff0f-429b-adcd-f2d5f2fb17ca tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:08.717247 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.wsgi [None req-6eacfd71-ff0f-429b-adcd-f2d5f2fb17ca tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] HTTP exception thrown: Instance 35c086d9-50bf-494a-90bb-694569f861a8 could not be found. May 31 21:05:08.724359 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-6eacfd71-ff0f-429b-adcd-f2d5f2fb17ca tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Request method failure captured: May 31 21:05:08.724359 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: request: GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8 HTTP/1.1 May 31 21:05:08.724359 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Accept: application/json May 31 21:05:08.724359 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Accept-Encoding: identity May 31 21:05:08.724359 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Connection: close May 31 21:05:08.724359 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Content-Length: 0 May 31 21:05:08.724359 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Content-Type: application/json May 31 21:05:08.724359 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Host: 10.222.0.55 May 31 21:05:08.724359 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Openstack-System-Scope: None May 31 21:05:08.724359 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: User-Agent: python-urllib3/1.26.9 May 31 21:05:08.724359 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Auth-Token: gAAAAABiloKXrlodgMyHvCJ0EAIpmJEauN8hIC27NU8EEhN16Himp9SkjloVM0lGTYfxBeUacqAgIz2acJlj6sFdqnkD_MPuizKsmA0UbAmpaX6MOKEnOcMxBo1GvGIrHA7CBs4lCEAp_RET4aGrIyS1fhgPpDfCKcYMcQ9_k1FwnQh59TLhApc May 31 21:05:08.724359 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Domain-Id: None May 31 21:05:08.724359 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Domain-Name: None May 31 21:05:08.724359 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Identity-Status: Confirmed May 31 21:05:08.724359 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Is-Admin-Project: True May 31 21:05:08.724359 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Domain-Id: default May 31 21:05:08.724359 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Domain-Name: Default May 31 21:05:08.724359 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Id: 96f91ac37f864ed98a03f9082252e334 May 31 21:05:08.724359 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Name: tempest-DeleteServersTestJSON-1111261823 May 31 21:05:08.724359 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Role: member,reader May 31 21:05:08.724359 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Roles: member,reader May 31 21:05:08.725821 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/96f91ac37f864ed98a03f9082252e334"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/96f91ac37f864ed98a03f9082252e334"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_96f91ac37f864ed98a03f9082252e334", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/96f91ac37f864ed98a03f9082252e334"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] May 31 21:05:08.725821 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant: tempest-DeleteServersTestJSON-1111261823 May 31 21:05:08.725821 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant-Id: 96f91ac37f864ed98a03f9082252e334 May 31 21:05:08.725821 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant-Name: tempest-DeleteServersTestJSON-1111261823 May 31 21:05:08.725821 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User: tempest-DeleteServersTestJSON-1111261823-project May 31 21:05:08.725821 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Domain-Id: default May 31 21:05:08.725821 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Domain-Name: Default May 31 21:05:08.725821 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Id: d5b358c38b5a44d798f7f53c4b318134 May 31 21:05:08.725821 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Name: tempest-DeleteServersTestJSON-1111261823-project May 31 21:05:08.725821 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: method: > May 31 21:05:08.725821 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: exception: Instance 35c086d9-50bf-494a-90bb-694569f861a8 could not be found. May 31 21:05:08.725821 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: action_args: {'id': '35c086d9-50bf-494a-90bb-694569f861a8'} May 31 21:05:08.726606 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 21:05:08.726606 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:05:08.726606 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 21:05:08.726606 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 21:05:08.726606 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 21:05:08.726606 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 21:05:08.726606 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 21:05:08.726606 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 21:05:08.726606 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 21:05:08.726606 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 21:05:08.726606 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35c086d9-50bf-494a-90bb-694569f861a8 could not be found. May 31 21:05:08.726606 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:05:08.726606 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:05:08.726606 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:05:08.726606 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:05:08.726606 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:05:08.726606 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:05:08.726606 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 21:05:08.726606 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 21:05:08.726606 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 21:05:08.727941 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 21:05:08.727941 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 21:05:08.727941 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 21:05:08.727941 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 21:05:08.727941 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 21:05:08.727941 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 21:05:08.727941 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 21:05:08.727941 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35c086d9-50bf-494a-90bb-694569f861a8 could not be found. May 31 21:05:08.727941 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:05:08.727941 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:05:08.727941 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:05:08.727941 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:05:08.727941 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:05:08.727941 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:05:08.727941 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 21:05:08.727941 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 21:05:08.727941 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35c086d9-50bf-494a-90bb-694569f861a8 could not be found. May 31 21:05:08.727941 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:05:08.731214 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-6eacfd71-ff0f-429b-adcd-f2d5f2fb17ca tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Returning 404 to user: Instance 35c086d9-50bf-494a-90bb-694569f861a8 could not be found. {{(pid=118185) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 21:05:08.732317 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-6eacfd71-ff0f-429b-adcd-f2d5f2fb17ca tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] 10.222.0.55 "GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8" status: 404 len: 111 microversion: 2.1 time: 0.074913 May 31 21:05:08.733516 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 112/261] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:05:08 2022] GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 31 21:05:09.462898 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-005d5a3c-2d2c-46d7-8986-0cfda0c8ddd9 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:05:09.462898 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-005d5a3c-2d2c-46d7-8986-0cfda0c8ddd9 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 9bff085f-5477-4588-9e08-533189d2db08] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:05:09.462898 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-005d5a3c-2d2c-46d7-8986-0cfda0c8ddd9 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:09.462898 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-005d5a3c-2d2c-46d7-8986-0cfda0c8ddd9 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:09.467128 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-005d5a3c-2d2c-46d7-8986-0cfda0c8ddd9 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:09.467128 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-005d5a3c-2d2c-46d7-8986-0cfda0c8ddd9 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:09.616679 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-bd91d322-1f33-4c40-af1e-04b97b1c178b tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:05:09.619338 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-bd91d322-1f33-4c40-af1e-04b97b1c178b tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] [instance: 35c086d9-50bf-494a-90bb-694569f861a8] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:05:09.640386 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-bd91d322-1f33-4c40-af1e-04b97b1c178b tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:09.641571 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-bd91d322-1f33-4c40-af1e-04b97b1c178b tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:09.643537 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-bd91d322-1f33-4c40-af1e-04b97b1c178b tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:09.645843 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-bd91d322-1f33-4c40-af1e-04b97b1c178b tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:09.699188 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.wsgi [None req-bd91d322-1f33-4c40-af1e-04b97b1c178b tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] HTTP exception thrown: Instance 35c086d9-50bf-494a-90bb-694569f861a8 could not be found. May 31 21:05:09.704714 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-bd91d322-1f33-4c40-af1e-04b97b1c178b tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Request method failure captured: May 31 21:05:09.704714 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: request: GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8/os-volume_attachments HTTP/1.1 May 31 21:05:09.704714 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Accept: application/json May 31 21:05:09.704714 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Accept-Encoding: identity May 31 21:05:09.704714 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Connection: close May 31 21:05:09.704714 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Content-Length: 0 May 31 21:05:09.704714 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Content-Type: application/json May 31 21:05:09.704714 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Host: 10.222.0.55 May 31 21:05:09.704714 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Openstack-System-Scope: None May 31 21:05:09.704714 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: User-Agent: python-urllib3/1.26.9 May 31 21:05:09.704714 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Auth-Token: gAAAAABiloKXrlodgMyHvCJ0EAIpmJEauN8hIC27NU8EEhN16Himp9SkjloVM0lGTYfxBeUacqAgIz2acJlj6sFdqnkD_MPuizKsmA0UbAmpaX6MOKEnOcMxBo1GvGIrHA7CBs4lCEAp_RET4aGrIyS1fhgPpDfCKcYMcQ9_k1FwnQh59TLhApc May 31 21:05:09.704714 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Domain-Id: None May 31 21:05:09.704714 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Domain-Name: None May 31 21:05:09.704714 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Identity-Status: Confirmed May 31 21:05:09.704714 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Is-Admin-Project: True May 31 21:05:09.704714 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Domain-Id: default May 31 21:05:09.704714 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Domain-Name: Default May 31 21:05:09.704714 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Id: 96f91ac37f864ed98a03f9082252e334 May 31 21:05:09.704714 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Name: tempest-DeleteServersTestJSON-1111261823 May 31 21:05:09.704714 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Role: member,reader May 31 21:05:09.704714 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Roles: member,reader May 31 21:05:09.707978 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/96f91ac37f864ed98a03f9082252e334"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/96f91ac37f864ed98a03f9082252e334"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_96f91ac37f864ed98a03f9082252e334", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/96f91ac37f864ed98a03f9082252e334"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] May 31 21:05:09.707978 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant: tempest-DeleteServersTestJSON-1111261823 May 31 21:05:09.707978 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant-Id: 96f91ac37f864ed98a03f9082252e334 May 31 21:05:09.707978 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant-Name: tempest-DeleteServersTestJSON-1111261823 May 31 21:05:09.707978 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User: tempest-DeleteServersTestJSON-1111261823-project May 31 21:05:09.707978 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Domain-Id: default May 31 21:05:09.707978 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Domain-Name: Default May 31 21:05:09.707978 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Id: d5b358c38b5a44d798f7f53c4b318134 May 31 21:05:09.707978 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Name: tempest-DeleteServersTestJSON-1111261823-project May 31 21:05:09.707978 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: method: > May 31 21:05:09.707978 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: exception: Instance 35c086d9-50bf-494a-90bb-694569f861a8 could not be found. May 31 21:05:09.707978 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: action_args: {'server_id': '35c086d9-50bf-494a-90bb-694569f861a8'} May 31 21:05:09.709474 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 21:05:09.709474 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:05:09.709474 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 21:05:09.709474 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 21:05:09.709474 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 21:05:09.709474 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 21:05:09.709474 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 21:05:09.709474 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 21:05:09.709474 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 21:05:09.709474 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 21:05:09.709474 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35c086d9-50bf-494a-90bb-694569f861a8 could not be found. May 31 21:05:09.709474 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:05:09.709474 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:05:09.709474 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:05:09.709474 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:05:09.709474 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:05:09.709474 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:05:09.709474 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 21:05:09.709474 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 21:05:09.709474 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 21:05:09.712067 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 21:05:09.712067 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 31 21:05:09.712067 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 31 21:05:09.712067 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 31 21:05:09.712067 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 31 21:05:09.712067 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 31 21:05:09.712067 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 31 21:05:09.712067 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 21:05:09.712067 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 21:05:09.712067 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35c086d9-50bf-494a-90bb-694569f861a8 could not be found. May 31 21:05:09.712067 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:05:09.712067 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:05:09.712067 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:05:09.712067 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:05:09.712067 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:05:09.712067 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:05:09.712067 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 21:05:09.712067 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 21:05:09.712067 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35c086d9-50bf-494a-90bb-694569f861a8 could not be found. May 31 21:05:09.712067 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:05:09.715625 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-bd91d322-1f33-4c40-af1e-04b97b1c178b tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Returning 404 to user: Instance 35c086d9-50bf-494a-90bb-694569f861a8 could not be found. {{(pid=118185) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 21:05:09.715625 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-bd91d322-1f33-4c40-af1e-04b97b1c178b tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] 10.222.0.55 "GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.100655 May 31 21:05:09.715965 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 113/262] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 31 21:05:09 2022] GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8/os-volume_attachments => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 21:05:09.787183 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-005d5a3c-2d2c-46d7-8986-0cfda0c8ddd9 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:05:09.799161 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:09.803191 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-005d5a3c-2d2c-46d7-8986-0cfda0c8ddd9 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08" status: 200 len: 1502 microversion: 2.1 time: 0.391158 May 31 21:05:09.804184 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 150/263] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:05:09 2022] GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08 => generated 1502 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:05:09.834697 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-cdcb3795-df87-41dc-a40b-713a9cf42f5c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:05:09.835971 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-cdcb3795-df87-41dc-a40b-713a9cf42f5c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 24059932-87a0-4e56-8bb0-4797276e2042] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:05:09.854385 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-cdcb3795-df87-41dc-a40b-713a9cf42f5c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:09.864169 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-cdcb3795-df87-41dc-a40b-713a9cf42f5c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:09.869428 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-cdcb3795-df87-41dc-a40b-713a9cf42f5c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:09.869428 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-cdcb3795-df87-41dc-a40b-713a9cf42f5c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:10.210895 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-cdcb3795-df87-41dc-a40b-713a9cf42f5c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:05:10.227177 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-cdcb3795-df87-41dc-a40b-713a9cf42f5c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/24059932-87a0-4e56-8bb0-4797276e2042" status: 200 len: 1517 microversion: 2.1 time: 0.394397 May 31 21:05:10.227177 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 114/264] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:05:09 2022] GET /compute/v2.1/servers/24059932-87a0-4e56-8bb0-4797276e2042 => generated 1517 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:05:12.167260 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-8ea32083-e3c5-4d08-91ba-81628c61ead8 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:05:12.170909 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-8ea32083-e3c5-4d08-91ba-81628c61ead8 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] [instance: 35c086d9-50bf-494a-90bb-694569f861a8] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:05:12.230197 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-8ea32083-e3c5-4d08-91ba-81628c61ead8 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:12.231825 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-8ea32083-e3c5-4d08-91ba-81628c61ead8 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:12.233840 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-8ea32083-e3c5-4d08-91ba-81628c61ead8 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:12.236766 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-8ea32083-e3c5-4d08-91ba-81628c61ead8 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:12.304699 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.wsgi [None req-8ea32083-e3c5-4d08-91ba-81628c61ead8 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] HTTP exception thrown: Instance 35c086d9-50bf-494a-90bb-694569f861a8 could not be found. May 31 21:05:12.310201 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-8ea32083-e3c5-4d08-91ba-81628c61ead8 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Request method failure captured: May 31 21:05:12.310201 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: request: DELETE /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8 HTTP/1.1 May 31 21:05:12.310201 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Accept: application/json May 31 21:05:12.310201 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Accept-Encoding: identity May 31 21:05:12.310201 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Connection: close May 31 21:05:12.310201 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Content-Length: 0 May 31 21:05:12.310201 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Content-Type: application/json May 31 21:05:12.310201 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Host: 10.222.0.55 May 31 21:05:12.310201 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Openstack-System-Scope: None May 31 21:05:12.310201 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: User-Agent: python-urllib3/1.26.9 May 31 21:05:12.310201 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Auth-Token: gAAAAABiloKXrlodgMyHvCJ0EAIpmJEauN8hIC27NU8EEhN16Himp9SkjloVM0lGTYfxBeUacqAgIz2acJlj6sFdqnkD_MPuizKsmA0UbAmpaX6MOKEnOcMxBo1GvGIrHA7CBs4lCEAp_RET4aGrIyS1fhgPpDfCKcYMcQ9_k1FwnQh59TLhApc May 31 21:05:12.310201 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Domain-Id: None May 31 21:05:12.310201 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Domain-Name: None May 31 21:05:12.310201 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Identity-Status: Confirmed May 31 21:05:12.310201 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Is-Admin-Project: True May 31 21:05:12.310201 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Domain-Id: default May 31 21:05:12.310201 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Domain-Name: Default May 31 21:05:12.310201 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Id: 96f91ac37f864ed98a03f9082252e334 May 31 21:05:12.310201 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Name: tempest-DeleteServersTestJSON-1111261823 May 31 21:05:12.310201 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Role: member,reader May 31 21:05:12.310201 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Roles: member,reader May 31 21:05:12.313413 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/96f91ac37f864ed98a03f9082252e334"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/96f91ac37f864ed98a03f9082252e334"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_96f91ac37f864ed98a03f9082252e334", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/96f91ac37f864ed98a03f9082252e334"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] May 31 21:05:12.313413 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant: tempest-DeleteServersTestJSON-1111261823 May 31 21:05:12.313413 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant-Id: 96f91ac37f864ed98a03f9082252e334 May 31 21:05:12.313413 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant-Name: tempest-DeleteServersTestJSON-1111261823 May 31 21:05:12.313413 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User: tempest-DeleteServersTestJSON-1111261823-project May 31 21:05:12.313413 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Domain-Id: default May 31 21:05:12.313413 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Domain-Name: Default May 31 21:05:12.313413 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Id: d5b358c38b5a44d798f7f53c4b318134 May 31 21:05:12.313413 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Name: tempest-DeleteServersTestJSON-1111261823-project May 31 21:05:12.313413 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: method: > May 31 21:05:12.313413 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: exception: Instance 35c086d9-50bf-494a-90bb-694569f861a8 could not be found. May 31 21:05:12.313413 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: action_args: {'id': '35c086d9-50bf-494a-90bb-694569f861a8'} May 31 21:05:12.315509 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 21:05:12.315509 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:05:12.315509 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 21:05:12.315509 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 21:05:12.315509 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 21:05:12.315509 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 21:05:12.315509 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 21:05:12.315509 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 21:05:12.315509 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 21:05:12.315509 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 21:05:12.315509 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35c086d9-50bf-494a-90bb-694569f861a8 could not be found. May 31 21:05:12.315509 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:05:12.315509 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:05:12.315509 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:05:12.315509 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:05:12.315509 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:05:12.315509 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:05:12.315509 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 21:05:12.315509 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 21:05:12.315509 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 21:05:12.328837 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 21:05:12.328837 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 31 21:05:12.328837 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 31 21:05:12.328837 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 31 21:05:12.328837 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 31 21:05:12.328837 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 21:05:12.328837 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 21:05:12.328837 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 21:05:12.328837 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 21:05:12.328837 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35c086d9-50bf-494a-90bb-694569f861a8 could not be found. May 31 21:05:12.328837 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:05:12.328837 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:05:12.328837 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:05:12.328837 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:05:12.328837 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:05:12.328837 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:05:12.328837 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 21:05:12.328837 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 21:05:12.328837 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35c086d9-50bf-494a-90bb-694569f861a8 could not be found. May 31 21:05:12.328837 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:05:12.333324 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-8ea32083-e3c5-4d08-91ba-81628c61ead8 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Returning 404 to user: Instance 35c086d9-50bf-494a-90bb-694569f861a8 could not be found. {{(pid=118184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 21:05:12.333324 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-8ea32083-e3c5-4d08-91ba-81628c61ead8 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] 10.222.0.55 "DELETE /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8" status: 404 len: 111 microversion: 2.1 time: 0.167722 May 31 21:05:12.333324 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 151/265] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 31 21:05:12 2022] DELETE /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8 => generated 111 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 21:05:12.343655 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-110dea84-3e41-4075-a112-58570a2f5a62 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:05:12.346035 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-110dea84-3e41-4075-a112-58570a2f5a62 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] [instance: 35c086d9-50bf-494a-90bb-694569f861a8] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:05:12.360473 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-110dea84-3e41-4075-a112-58570a2f5a62 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:12.361747 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-110dea84-3e41-4075-a112-58570a2f5a62 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:12.363892 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-110dea84-3e41-4075-a112-58570a2f5a62 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:12.365031 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-110dea84-3e41-4075-a112-58570a2f5a62 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:12.407129 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.wsgi [None req-110dea84-3e41-4075-a112-58570a2f5a62 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] HTTP exception thrown: Instance 35c086d9-50bf-494a-90bb-694569f861a8 could not be found. May 31 21:05:12.412881 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-110dea84-3e41-4075-a112-58570a2f5a62 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Request method failure captured: May 31 21:05:12.412881 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: request: GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8 HTTP/1.1 May 31 21:05:12.412881 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Accept: application/json May 31 21:05:12.412881 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Accept-Encoding: identity May 31 21:05:12.412881 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Connection: close May 31 21:05:12.412881 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Content-Length: 0 May 31 21:05:12.412881 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Content-Type: application/json May 31 21:05:12.412881 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Host: 10.222.0.55 May 31 21:05:12.412881 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Openstack-System-Scope: None May 31 21:05:12.412881 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: User-Agent: python-urllib3/1.26.9 May 31 21:05:12.412881 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Auth-Token: gAAAAABiloKXrlodgMyHvCJ0EAIpmJEauN8hIC27NU8EEhN16Himp9SkjloVM0lGTYfxBeUacqAgIz2acJlj6sFdqnkD_MPuizKsmA0UbAmpaX6MOKEnOcMxBo1GvGIrHA7CBs4lCEAp_RET4aGrIyS1fhgPpDfCKcYMcQ9_k1FwnQh59TLhApc May 31 21:05:12.412881 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Domain-Id: None May 31 21:05:12.412881 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Domain-Name: None May 31 21:05:12.412881 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Identity-Status: Confirmed May 31 21:05:12.412881 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Is-Admin-Project: True May 31 21:05:12.412881 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Domain-Id: default May 31 21:05:12.412881 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Domain-Name: Default May 31 21:05:12.412881 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Id: 96f91ac37f864ed98a03f9082252e334 May 31 21:05:12.412881 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Name: tempest-DeleteServersTestJSON-1111261823 May 31 21:05:12.412881 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Role: member,reader May 31 21:05:12.412881 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Roles: member,reader May 31 21:05:12.417289 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/96f91ac37f864ed98a03f9082252e334"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/96f91ac37f864ed98a03f9082252e334"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_96f91ac37f864ed98a03f9082252e334", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/96f91ac37f864ed98a03f9082252e334"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] May 31 21:05:12.417289 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant: tempest-DeleteServersTestJSON-1111261823 May 31 21:05:12.417289 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant-Id: 96f91ac37f864ed98a03f9082252e334 May 31 21:05:12.417289 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant-Name: tempest-DeleteServersTestJSON-1111261823 May 31 21:05:12.417289 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User: tempest-DeleteServersTestJSON-1111261823-project May 31 21:05:12.417289 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Domain-Id: default May 31 21:05:12.417289 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Domain-Name: Default May 31 21:05:12.417289 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Id: d5b358c38b5a44d798f7f53c4b318134 May 31 21:05:12.417289 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Name: tempest-DeleteServersTestJSON-1111261823-project May 31 21:05:12.417289 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: method: > May 31 21:05:12.417289 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: exception: Instance 35c086d9-50bf-494a-90bb-694569f861a8 could not be found. May 31 21:05:12.417289 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: action_args: {'id': '35c086d9-50bf-494a-90bb-694569f861a8'} May 31 21:05:12.420650 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 21:05:12.420650 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:05:12.420650 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 21:05:12.420650 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 21:05:12.420650 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 21:05:12.420650 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 21:05:12.420650 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 21:05:12.420650 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 21:05:12.420650 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 21:05:12.420650 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 21:05:12.420650 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35c086d9-50bf-494a-90bb-694569f861a8 could not be found. May 31 21:05:12.420650 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:05:12.420650 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:05:12.420650 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:05:12.420650 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:05:12.420650 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:05:12.420650 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:05:12.420650 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 21:05:12.420650 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 21:05:12.420650 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 21:05:12.436253 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 21:05:12.436253 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 21:05:12.436253 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 21:05:12.436253 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 21:05:12.436253 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 21:05:12.436253 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 21:05:12.436253 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 21:05:12.436253 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35c086d9-50bf-494a-90bb-694569f861a8 could not be found. May 31 21:05:12.436253 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:05:12.436253 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:05:12.436253 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:05:12.436253 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:05:12.436253 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:05:12.436253 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:05:12.436253 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 21:05:12.436253 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 21:05:12.436253 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35c086d9-50bf-494a-90bb-694569f861a8 could not be found. May 31 21:05:12.436253 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:05:12.441137 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-110dea84-3e41-4075-a112-58570a2f5a62 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] Returning 404 to user: Instance 35c086d9-50bf-494a-90bb-694569f861a8 could not be found. {{(pid=118185) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 21:05:12.441137 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-110dea84-3e41-4075-a112-58570a2f5a62 tempest-DeleteServersTestJSON-1111261823 tempest-DeleteServersTestJSON-1111261823-project] 10.222.0.55 "GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8" status: 404 len: 111 microversion: 2.1 time: 0.095049 May 31 21:05:12.441137 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 115/266] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:05:12 2022] GET /compute/v2.1/servers/35c086d9-50bf-494a-90bb-694569f861a8 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 21:05:13.903789 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-f90b5026-e580-49cd-919c-7e05445f3948 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:05:13.905839 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-f90b5026-e580-49cd-919c-7e05445f3948 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 24059932-87a0-4e56-8bb0-4797276e2042] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:05:13.918672 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f90b5026-e580-49cd-919c-7e05445f3948 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:13.919912 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f90b5026-e580-49cd-919c-7e05445f3948 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:13.921472 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f90b5026-e580-49cd-919c-7e05445f3948 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:13.922133 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f90b5026-e580-49cd-919c-7e05445f3948 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:13.953553 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.objects.instance [None req-f90b5026-e580-49cd-919c-7e05445f3948 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lazy-loading 'flavor' on Instance uuid 24059932-87a0-4e56-8bb0-4797276e2042 {{(pid=118184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 21:05:14.628255 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-f90b5026-e580-49cd-919c-7e05445f3948 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "POST /compute/v2.1/servers/24059932-87a0-4e56-8bb0-4797276e2042/action" status: 200 len: 32 microversion: 2.1 time: 0.731469 May 31 21:05:14.635050 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 152/267] 10.222.0.55 () {60 vars in 1277 bytes} [Tue May 31 21:05:13 2022] POST /compute/v2.1/servers/24059932-87a0-4e56-8bb0-4797276e2042/action => generated 32 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 31 21:05:14.653464 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-5d6e2dc3-c518-4aaf-a2ed-8f1a96cd0717 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:05:14.657954 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-5d6e2dc3-c518-4aaf-a2ed-8f1a96cd0717 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 24059932-87a0-4e56-8bb0-4797276e2042] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:05:14.693587 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-5d6e2dc3-c518-4aaf-a2ed-8f1a96cd0717 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:14.696521 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-5d6e2dc3-c518-4aaf-a2ed-8f1a96cd0717 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:14.699506 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-5d6e2dc3-c518-4aaf-a2ed-8f1a96cd0717 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:14.701447 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-5d6e2dc3-c518-4aaf-a2ed-8f1a96cd0717 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:14.755068 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell1:SELECT=100 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:15.016000 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-5d6e2dc3-c518-4aaf-a2ed-8f1a96cd0717 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:05:15.032019 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-5d6e2dc3-c518-4aaf-a2ed-8f1a96cd0717 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/24059932-87a0-4e56-8bb0-4797276e2042" status: 200 len: 1523 microversion: 2.1 time: 0.388112 May 31 21:05:15.045348 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 116/268] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:05:14 2022] GET /compute/v2.1/servers/24059932-87a0-4e56-8bb0-4797276e2042 => generated 1523 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:05:16.062388 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-ec3a1441-ba8a-427b-b436-b96e963da77e tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:05:16.074534 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-ec3a1441-ba8a-427b-b436-b96e963da77e tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 24059932-87a0-4e56-8bb0-4797276e2042] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:05:16.110648 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ec3a1441-ba8a-427b-b436-b96e963da77e tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:16.111473 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ec3a1441-ba8a-427b-b436-b96e963da77e tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:16.112972 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ec3a1441-ba8a-427b-b436-b96e963da77e tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:16.131614 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ec3a1441-ba8a-427b-b436-b96e963da77e tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:16.534537 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-ec3a1441-ba8a-427b-b436-b96e963da77e tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:05:16.551737 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-ec3a1441-ba8a-427b-b436-b96e963da77e tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/24059932-87a0-4e56-8bb0-4797276e2042" status: 200 len: 1523 microversion: 2.1 time: 0.498253 May 31 21:05:16.553166 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 153/269] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:05:16 2022] GET /compute/v2.1/servers/24059932-87a0-4e56-8bb0-4797276e2042 => generated 1523 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:05:17.571140 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-3873d8ac-139c-4b36-b8f1-c04da1b54e32 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:05:17.572053 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-3873d8ac-139c-4b36-b8f1-c04da1b54e32 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 24059932-87a0-4e56-8bb0-4797276e2042] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:05:17.588953 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-3873d8ac-139c-4b36-b8f1-c04da1b54e32 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:17.589449 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-3873d8ac-139c-4b36-b8f1-c04da1b54e32 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:17.591761 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-3873d8ac-139c-4b36-b8f1-c04da1b54e32 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:17.592469 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-3873d8ac-139c-4b36-b8f1-c04da1b54e32 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:18.044790 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-3873d8ac-139c-4b36-b8f1-c04da1b54e32 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:05:18.061657 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-3873d8ac-139c-4b36-b8f1-c04da1b54e32 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/24059932-87a0-4e56-8bb0-4797276e2042" status: 200 len: 1523 microversion: 2.1 time: 0.493456 May 31 21:05:18.078246 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 117/270] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:05:17 2022] GET /compute/v2.1/servers/24059932-87a0-4e56-8bb0-4797276e2042 => generated 1523 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:05:19.093615 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-47cb9dfa-b1b8-44ac-b23d-944f2c8ea174 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:05:19.094637 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-47cb9dfa-b1b8-44ac-b23d-944f2c8ea174 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 24059932-87a0-4e56-8bb0-4797276e2042] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:05:19.120332 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-47cb9dfa-b1b8-44ac-b23d-944f2c8ea174 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:19.121496 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-47cb9dfa-b1b8-44ac-b23d-944f2c8ea174 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:19.126142 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-47cb9dfa-b1b8-44ac-b23d-944f2c8ea174 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:19.127476 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-47cb9dfa-b1b8-44ac-b23d-944f2c8ea174 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:19.480803 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-47cb9dfa-b1b8-44ac-b23d-944f2c8ea174 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:05:19.510579 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-47cb9dfa-b1b8-44ac-b23d-944f2c8ea174 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/24059932-87a0-4e56-8bb0-4797276e2042" status: 200 len: 1523 microversion: 2.1 time: 0.421802 May 31 21:05:19.529316 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 154/271] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:05:19 2022] GET /compute/v2.1/servers/24059932-87a0-4e56-8bb0-4797276e2042 => generated 1523 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:05:20.540985 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-520d089c-4426-4022-b76c-41aee8123763 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:05:20.542203 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-520d089c-4426-4022-b76c-41aee8123763 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 24059932-87a0-4e56-8bb0-4797276e2042] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:05:20.555780 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-520d089c-4426-4022-b76c-41aee8123763 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:20.556417 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-520d089c-4426-4022-b76c-41aee8123763 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:20.558120 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-520d089c-4426-4022-b76c-41aee8123763 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:20.558635 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-520d089c-4426-4022-b76c-41aee8123763 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:20.792992 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-520d089c-4426-4022-b76c-41aee8123763 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:05:20.825459 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-520d089c-4426-4022-b76c-41aee8123763 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/24059932-87a0-4e56-8bb0-4797276e2042" status: 200 len: 1523 microversion: 2.1 time: 0.277917 May 31 21:05:20.827988 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 118/272] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:05:20 2022] GET /compute/v2.1/servers/24059932-87a0-4e56-8bb0-4797276e2042 => generated 1523 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:05:21.847652 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-91b32c98-b6b0-40f1-a0f8-4d7fc047f6ea tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:05:21.848713 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-91b32c98-b6b0-40f1-a0f8-4d7fc047f6ea tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 24059932-87a0-4e56-8bb0-4797276e2042] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:05:21.865598 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-91b32c98-b6b0-40f1-a0f8-4d7fc047f6ea tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:21.874093 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-91b32c98-b6b0-40f1-a0f8-4d7fc047f6ea tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:21.874093 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-91b32c98-b6b0-40f1-a0f8-4d7fc047f6ea tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:21.874093 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-91b32c98-b6b0-40f1-a0f8-4d7fc047f6ea tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:22.024099 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-91b32c98-b6b0-40f1-a0f8-4d7fc047f6ea tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:05:22.032861 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-91b32c98-b6b0-40f1-a0f8-4d7fc047f6ea tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/24059932-87a0-4e56-8bb0-4797276e2042" status: 200 len: 1523 microversion: 2.1 time: 0.192121 May 31 21:05:22.033609 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 155/273] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:05:21 2022] GET /compute/v2.1/servers/24059932-87a0-4e56-8bb0-4797276e2042 => generated 1523 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:05:23.060473 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-4d5d1676-90b5-4b3d-aa7d-09a32b571238 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:05:23.061288 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-4d5d1676-90b5-4b3d-aa7d-09a32b571238 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 24059932-87a0-4e56-8bb0-4797276e2042] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:05:23.069160 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4d5d1676-90b5-4b3d-aa7d-09a32b571238 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:23.071287 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4d5d1676-90b5-4b3d-aa7d-09a32b571238 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:23.073605 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4d5d1676-90b5-4b3d-aa7d-09a32b571238 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:23.074096 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4d5d1676-90b5-4b3d-aa7d-09a32b571238 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:23.386765 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-4d5d1676-90b5-4b3d-aa7d-09a32b571238 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:05:23.397328 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-4d5d1676-90b5-4b3d-aa7d-09a32b571238 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/24059932-87a0-4e56-8bb0-4797276e2042" status: 200 len: 1523 microversion: 2.1 time: 0.342834 May 31 21:05:23.398390 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 119/274] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:05:23 2022] GET /compute/v2.1/servers/24059932-87a0-4e56-8bb0-4797276e2042 => generated 1523 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:05:24.427060 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-51828a1e-033f-4bec-8abc-a3a314ee2bc3 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:05:24.429747 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-51828a1e-033f-4bec-8abc-a3a314ee2bc3 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 24059932-87a0-4e56-8bb0-4797276e2042] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:05:24.463939 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-51828a1e-033f-4bec-8abc-a3a314ee2bc3 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:24.465272 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-51828a1e-033f-4bec-8abc-a3a314ee2bc3 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:24.467143 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-51828a1e-033f-4bec-8abc-a3a314ee2bc3 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:24.470262 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-51828a1e-033f-4bec-8abc-a3a314ee2bc3 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:24.733481 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-51828a1e-033f-4bec-8abc-a3a314ee2bc3 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:05:24.744775 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-51828a1e-033f-4bec-8abc-a3a314ee2bc3 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/24059932-87a0-4e56-8bb0-4797276e2042" status: 200 len: 1523 microversion: 2.1 time: 0.325259 May 31 21:05:24.746512 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 156/275] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:05:24 2022] GET /compute/v2.1/servers/24059932-87a0-4e56-8bb0-4797276e2042 => generated 1523 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:05:25.763493 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-1337b26e-d3c6-47d7-bd8d-ba2ce4e71ec9 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:05:25.791742 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-1337b26e-d3c6-47d7-bd8d-ba2ce4e71ec9 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 24059932-87a0-4e56-8bb0-4797276e2042] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:05:25.791742 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-1337b26e-d3c6-47d7-bd8d-ba2ce4e71ec9 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:25.791742 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-1337b26e-d3c6-47d7-bd8d-ba2ce4e71ec9 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:25.791742 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-1337b26e-d3c6-47d7-bd8d-ba2ce4e71ec9 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:25.792119 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-1337b26e-d3c6-47d7-bd8d-ba2ce4e71ec9 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:25.953844 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-1337b26e-d3c6-47d7-bd8d-ba2ce4e71ec9 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:05:25.964966 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-1337b26e-d3c6-47d7-bd8d-ba2ce4e71ec9 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/24059932-87a0-4e56-8bb0-4797276e2042" status: 200 len: 1523 microversion: 2.1 time: 0.205284 May 31 21:05:25.965783 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 120/276] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:05:25 2022] GET /compute/v2.1/servers/24059932-87a0-4e56-8bb0-4797276e2042 => generated 1523 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:05:26.997101 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-1a79cbb0-030d-459b-87fc-c44457b8116d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:05:26.998316 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-1a79cbb0-030d-459b-87fc-c44457b8116d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 24059932-87a0-4e56-8bb0-4797276e2042] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:05:27.013839 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-1a79cbb0-030d-459b-87fc-c44457b8116d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:27.014641 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-1a79cbb0-030d-459b-87fc-c44457b8116d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:27.015539 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-1a79cbb0-030d-459b-87fc-c44457b8116d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:27.016377 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-1a79cbb0-030d-459b-87fc-c44457b8116d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:27.316361 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-1a79cbb0-030d-459b-87fc-c44457b8116d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:05:27.325735 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-1a79cbb0-030d-459b-87fc-c44457b8116d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/24059932-87a0-4e56-8bb0-4797276e2042" status: 200 len: 1523 microversion: 2.1 time: 0.345608 May 31 21:05:27.326674 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 157/277] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:05:26 2022] GET /compute/v2.1/servers/24059932-87a0-4e56-8bb0-4797276e2042 => generated 1523 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:05:27.913701 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-f57725b3-fb58-40f2-8966-94a37e9ed5fe tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Action: 'create', calling method: .version_select at 0x7fe7c0fde430>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-977709738", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOCXDLt1nVHbcDjE8uJ0iXjDUiDBchaO8rHc4+6JIdHwOAeJWdNVb9PE8SLMaSWepu8JwcoqpTowTDiqW2wCwKl9WvxCautZJeMlxs9dMlb5zDxBzNRbzl0DyIey5NffZQ=="}} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:05:27.930839 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.quota [None req-f57725b3-fb58-40f2-8966-94a37e9ed5fe tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Getting quotas for project 9f9ac73d84244b1c9029586fa4969bbf. Resources: {'key_pairs'} {{(pid=118185) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 21:05:27.935573 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.quota [None req-f57725b3-fb58-40f2-8966-94a37e9ed5fe tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Getting quotas for user 107ed6d5d4524a29a1c545cba5e8f5bf and project 9f9ac73d84244b1c9029586fa4969bbf. Resources: {'key_pairs'} {{(pid=118185) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 21:05:28.040921 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-f57725b3-fb58-40f2-8966-94a37e9ed5fe tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.131429 May 31 21:05:28.041543 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 121/278] 10.222.0.55 () {60 vars in 1158 bytes} [Tue May 31 21:05:27 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 21:05:28.144804 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-80da2ea6-3825-4be7-9d7f-a4feba82b588 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-641509323", "imageRef": "0b7dd41d-5699-40a5-8dcb-feef8ee4445e", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-977709738", "networks": [{"uuid": "3e967741-aa19-4db4-8371-4ee869c23fa1"}]}} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:05:28.220522 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.network.neutron [None req-80da2ea6-3825-4be7-9d7f-a4feba82b588 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] validate_networks() for [('3e967741-aa19-4db4-8371-4ee869c23fa1', None, None, None, None, None)] {{(pid=118184) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 21:05:28.345948 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-f1fb75dc-c158-4a22-8310-8ba212c6e79c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:05:28.346617 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-f1fb75dc-c158-4a22-8310-8ba212c6e79c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 24059932-87a0-4e56-8bb0-4797276e2042] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:05:28.349401 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=1 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:28.381473 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f1fb75dc-c158-4a22-8310-8ba212c6e79c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:28.382051 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f1fb75dc-c158-4a22-8310-8ba212c6e79c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:28.383332 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f1fb75dc-c158-4a22-8310-8ba212c6e79c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:28.384622 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f1fb75dc-c158-4a22-8310-8ba212c6e79c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:28.684009 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-f1fb75dc-c158-4a22-8310-8ba212c6e79c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:05:28.699438 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-f1fb75dc-c158-4a22-8310-8ba212c6e79c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/24059932-87a0-4e56-8bb0-4797276e2042" status: 200 len: 1523 microversion: 2.1 time: 0.357727 May 31 21:05:28.700551 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 122/279] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:05:28 2022] GET /compute/v2.1/servers/24059932-87a0-4e56-8bb0-4797276e2042 => generated 1523 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:05:28.841056 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.virt.hardware [None req-80da2ea6-3825-4be7-9d7f-a4feba82b588 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Flavor limits 0:0:0 {{(pid=118184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 21:05:28.841476 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.virt.hardware [None req-80da2ea6-3825-4be7-9d7f-a4feba82b588 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Image limits 0:0:0 {{(pid=118184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 21:05:28.841975 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.virt.hardware [None req-80da2ea6-3825-4be7-9d7f-a4feba82b588 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Flavor pref 0:0:0 {{(pid=118184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 21:05:28.842380 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.virt.hardware [None req-80da2ea6-3825-4be7-9d7f-a4feba82b588 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Image pref 0:0:0 {{(pid=118184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 21:05:28.842814 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.virt.hardware [None req-80da2ea6-3825-4be7-9d7f-a4feba82b588 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 21:05:28.854826 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-80da2ea6-3825-4be7-9d7f-a4feba82b588 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:28.855597 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-80da2ea6-3825-4be7-9d7f-a4feba82b588 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:28.856437 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-80da2ea6-3825-4be7-9d7f-a4feba82b588 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:28.856906 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-80da2ea6-3825-4be7-9d7f-a4feba82b588 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:28.876166 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.quota [None req-80da2ea6-3825-4be7-9d7f-a4feba82b588 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Getting quotas for project 9f9ac73d84244b1c9029586fa4969bbf. Resources: {'ram', 'cores', 'instances'} {{(pid=118184) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 21:05:28.882412 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.quota [None req-80da2ea6-3825-4be7-9d7f-a4feba82b588 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Getting quotas for user 107ed6d5d4524a29a1c545cba5e8f5bf and project 9f9ac73d84244b1c9029586fa4969bbf. Resources: {'ram', 'cores', 'instances'} {{(pid=118184) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 21:05:28.902700 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-80da2ea6-3825-4be7-9d7f-a4feba82b588 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Going to run 1 instances... {{(pid=118184) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 21:05:28.906884 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-80da2ea6-3825-4be7-9d7f-a4feba82b588 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0b7dd41d-5699-40a5-8dcb-feef8ee4445e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118184) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 21:05:29.075083 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-80da2ea6-3825-4be7-9d7f-a4feba82b588 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.934283 May 31 21:05:29.076461 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 158/280] 10.222.0.55 () {60 vars in 1146 bytes} [Tue May 31 21:05:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 936 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 31 21:05:29.088694 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-7f68899f-0c38-44dc-96d0-50c8e596ec12 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:05:29.093703 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-7f68899f-0c38-44dc-96d0-50c8e596ec12 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:05:29.162427 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-7f68899f-0c38-44dc-96d0-50c8e596ec12 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:05:29.170307 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-7f68899f-0c38-44dc-96d0-50c8e596ec12 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1257 microversion: 2.1 time: 0.087150 May 31 21:05:29.170899 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 123/281] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:05:29 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1257 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:05:29.723476 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-4eb7584a-b53e-41ed-a7ff-82c2ca60085b tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:05:29.725204 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-4eb7584a-b53e-41ed-a7ff-82c2ca60085b tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 24059932-87a0-4e56-8bb0-4797276e2042] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:05:29.737019 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4eb7584a-b53e-41ed-a7ff-82c2ca60085b tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:29.741489 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4eb7584a-b53e-41ed-a7ff-82c2ca60085b tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:29.741489 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4eb7584a-b53e-41ed-a7ff-82c2ca60085b tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:29.741489 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4eb7584a-b53e-41ed-a7ff-82c2ca60085b tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:29.964681 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-4eb7584a-b53e-41ed-a7ff-82c2ca60085b tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:05:29.974170 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-4eb7584a-b53e-41ed-a7ff-82c2ca60085b tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/24059932-87a0-4e56-8bb0-4797276e2042" status: 200 len: 1503 microversion: 2.1 time: 0.258102 May 31 21:05:29.974756 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 159/282] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:05:29 2022] GET /compute/v2.1/servers/24059932-87a0-4e56-8bb0-4797276e2042 => generated 1503 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:05:29.996431 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-bcf33cb4-9673-4cf6-9b5b-ad9664fc3509 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7ffb0e07-5f57-4b9e-8a6e-657a45c9456f"}} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:05:29.997371 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-bcf33cb4-9673-4cf6-9b5b-ad9664fc3509 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 24059932-87a0-4e56-8bb0-4797276e2042] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:05:30.004773 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-bcf33cb4-9673-4cf6-9b5b-ad9664fc3509 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:30.005240 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-bcf33cb4-9673-4cf6-9b5b-ad9664fc3509 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:30.006161 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-bcf33cb4-9673-4cf6-9b5b-ad9664fc3509 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:30.006617 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-bcf33cb4-9673-4cf6-9b5b-ad9664fc3509 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:30.037069 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.wsgi [None req-bcf33cb4-9673-4cf6-9b5b-ad9664fc3509 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] HTTP exception thrown: Cannot 'attach_volume' instance 24059932-87a0-4e56-8bb0-4797276e2042 while it is in vm_state rescued May 31 21:05:30.039087 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-bcf33cb4-9673-4cf6-9b5b-ad9664fc3509 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Request method failure captured: May 31 21:05:30.039087 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: request: POST /compute/v2.1/servers/24059932-87a0-4e56-8bb0-4797276e2042/os-volume_attachments HTTP/1.1 May 31 21:05:30.039087 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Accept: application/json May 31 21:05:30.039087 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Accept-Encoding: identity May 31 21:05:30.039087 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Connection: close May 31 21:05:30.039087 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Content-Length: 74 May 31 21:05:30.039087 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Content-Type: application/json May 31 21:05:30.039087 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Host: 10.222.0.55 May 31 21:05:30.039087 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Openstack-System-Scope: None May 31 21:05:30.039087 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: User-Agent: python-urllib3/1.26.9 May 31 21:05:30.039087 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Auth-Token: gAAAAABiloKngpou4fcrhJSECdfOHFsnMzu14lCOGutNAWHrekz0pgYMq4g1wmFaJxYB11cNdAFG04NttpTVQ0IQX971BK1KwyKsW5u5cbGZqnRRimaXJ-Df08ghf2T6DQWELhQSwIrMDVTC_eNXuZkmjTncSbGwdASXfJc-kC3SbyJrBM1jos4 May 31 21:05:30.039087 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Domain-Id: None May 31 21:05:30.039087 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Domain-Name: None May 31 21:05:30.039087 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Identity-Status: Confirmed May 31 21:05:30.039087 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Is-Admin-Project: True May 31 21:05:30.039087 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Domain-Id: default May 31 21:05:30.039087 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Domain-Name: Default May 31 21:05:30.039087 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Id: f1b54ceb69fc4041b743a11eda4144a8 May 31 21:05:30.039087 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1103944919 May 31 21:05:30.039087 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Role: member,reader May 31 21:05:30.039087 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Roles: member,reader May 31 21:05:30.040533 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/f1b54ceb69fc4041b743a11eda4144a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f1b54ceb69fc4041b743a11eda4144a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_f1b54ceb69fc4041b743a11eda4144a8", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f1b54ceb69fc4041b743a11eda4144a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] May 31 21:05:30.040533 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1103944919 May 31 21:05:30.040533 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant-Id: f1b54ceb69fc4041b743a11eda4144a8 May 31 21:05:30.040533 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1103944919 May 31 21:05:30.040533 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User: tempest-ServerRescueNegativeTestJSON-1103944919-project May 31 21:05:30.040533 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Domain-Id: default May 31 21:05:30.040533 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Domain-Name: Default May 31 21:05:30.040533 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Id: bbf377756836405d804d2aaba6e44c1f May 31 21:05:30.040533 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1103944919-project May 31 21:05:30.040533 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: May 31 21:05:30.040533 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: {"volumeAttachment": {"volumeId": "7ffb0e07-5f57-4b9e-8a6e-657a45c9456f"}} May 31 21:05:30.040533 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: method: > May 31 21:05:30.041491 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: exception: Cannot 'attach_volume' instance 24059932-87a0-4e56-8bb0-4797276e2042 while it is in vm_state rescued May 31 21:05:30.041491 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: action_args: {'server_id': '24059932-87a0-4e56-8bb0-4797276e2042', 'body': {'volumeAttachment': {'volumeId': '7ffb0e07-5f57-4b9e-8a6e-657a45c9456f'}}} May 31 21:05:30.041491 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 21:05:30.041491 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:05:30.041491 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 31 21:05:30.041491 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 31 21:05:30.041491 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 31 21:05:30.041491 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 31 21:05:30.041491 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 31 21:05:30.041491 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 31 21:05:30.041491 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 24059932-87a0-4e56-8bb0-4797276e2042 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 31 21:05:30.041491 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:05:30.041491 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:05:30.041491 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:05:30.041491 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:05:30.041491 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:05:30.041491 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:05:30.041491 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 21:05:30.041491 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 21:05:30.049267 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 21:05:30.049267 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 21:05:30.049267 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 31 21:05:30.049267 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 31 21:05:30.049267 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 31 21:05:30.049267 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 31 21:05:30.049267 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 31 21:05:30.049267 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 31 21:05:30.049267 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 31 21:05:30.049267 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 31 21:05:30.049267 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 31 21:05:30.049267 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 31 21:05:30.049267 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 24059932-87a0-4e56-8bb0-4797276e2042 while it is in vm_state rescued May 31 21:05:30.049267 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:05:30.049267 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:05:30.049267 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:05:30.049267 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:05:30.049267 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:05:30.049267 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:05:30.051134 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 21:05:30.051134 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 21:05:30.051134 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 24059932-87a0-4e56-8bb0-4797276e2042 while it is in vm_state rescued May 31 21:05:30.051134 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:05:30.051134 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-bcf33cb4-9673-4cf6-9b5b-ad9664fc3509 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Returning 409 to user: Cannot 'attach_volume' instance 24059932-87a0-4e56-8bb0-4797276e2042 while it is in vm_state rescued {{(pid=118185) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 21:05:30.051134 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-bcf33cb4-9673-4cf6-9b5b-ad9664fc3509 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "POST /compute/v2.1/servers/24059932-87a0-4e56-8bb0-4797276e2042/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.052396 May 31 21:05:30.051134 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 124/283] 10.222.0.55 () {60 vars in 1322 bytes} [Tue May 31 21:05:29 2022] POST /compute/v2.1/servers/24059932-87a0-4e56-8bb0-4797276e2042/os-volume_attachments => generated 152 bytes in 54 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 31 21:05:30.057175 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-bf56cadb-e6b8-4575-9b5c-594a98d8b79f tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:05:30.057854 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-bf56cadb-e6b8-4575-9b5c-594a98d8b79f tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 24059932-87a0-4e56-8bb0-4797276e2042] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:05:30.077194 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-bf56cadb-e6b8-4575-9b5c-594a98d8b79f tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:30.077194 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-bf56cadb-e6b8-4575-9b5c-594a98d8b79f tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:30.077194 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-bf56cadb-e6b8-4575-9b5c-594a98d8b79f tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:30.077194 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-bf56cadb-e6b8-4575-9b5c-594a98d8b79f tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:30.188076 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-f1b595ef-bf4b-4ad9-8ab5-f691655b8ea6 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:05:30.188691 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-f1b595ef-bf4b-4ad9-8ab5-f691655b8ea6 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:05:30.260132 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-f1b595ef-bf4b-4ad9-8ab5-f691655b8ea6 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:05:30.269881 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-f1b595ef-bf4b-4ad9-8ab5-f691655b8ea6 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1257 microversion: 2.1 time: 0.085371 May 31 21:05:30.272672 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 125/284] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:05:30 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1257 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:05:30.378514 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-bf56cadb-e6b8-4575-9b5c-594a98d8b79f tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "POST /compute/v2.1/servers/24059932-87a0-4e56-8bb0-4797276e2042/action" status: 202 len: 0 microversion: 2.1 time: 0.325183 May 31 21:05:30.388501 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-23e949d2-afa3-421b-8d57-9f420708f7f3 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:05:30.389410 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-23e949d2-afa3-421b-8d57-9f420708f7f3 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 24059932-87a0-4e56-8bb0-4797276e2042] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:05:30.391018 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 160/285] 10.222.0.55 () {60 vars in 1277 bytes} [Tue May 31 21:05:30 2022] POST /compute/v2.1/servers/24059932-87a0-4e56-8bb0-4797276e2042/action => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 21:05:30.397215 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-23e949d2-afa3-421b-8d57-9f420708f7f3 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:30.398185 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-23e949d2-afa3-421b-8d57-9f420708f7f3 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:30.399638 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-23e949d2-afa3-421b-8d57-9f420708f7f3 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:30.400629 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-23e949d2-afa3-421b-8d57-9f420708f7f3 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:30.589022 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-23e949d2-afa3-421b-8d57-9f420708f7f3 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:05:30.602697 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-23e949d2-afa3-421b-8d57-9f420708f7f3 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/24059932-87a0-4e56-8bb0-4797276e2042" status: 200 len: 1511 microversion: 2.1 time: 0.218063 May 31 21:05:30.604240 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 126/286] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:05:30 2022] GET /compute/v2.1/servers/24059932-87a0-4e56-8bb0-4797276e2042 => generated 1511 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:05:31.288294 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-2ed1a666-d0da-4dd9-8d36-5d193a406dc0 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:05:31.289018 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-2ed1a666-d0da-4dd9-8d36-5d193a406dc0 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:05:31.297458 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2ed1a666-d0da-4dd9-8d36-5d193a406dc0 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:31.297993 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2ed1a666-d0da-4dd9-8d36-5d193a406dc0 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:31.298860 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2ed1a666-d0da-4dd9-8d36-5d193a406dc0 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:31.299310 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2ed1a666-d0da-4dd9-8d36-5d193a406dc0 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:31.377800 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-2ed1a666-d0da-4dd9-8d36-5d193a406dc0 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:05:31.387575 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-2ed1a666-d0da-4dd9-8d36-5d193a406dc0 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1253 microversion: 2.1 time: 0.103446 May 31 21:05:31.388306 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 161/287] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:05:31 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1253 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:05:31.621286 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-cc6cb17c-00bd-47a6-aa8a-c9ed9a884199 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:05:31.621942 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-cc6cb17c-00bd-47a6-aa8a-c9ed9a884199 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 24059932-87a0-4e56-8bb0-4797276e2042] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:05:31.631408 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-cc6cb17c-00bd-47a6-aa8a-c9ed9a884199 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:31.631893 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-cc6cb17c-00bd-47a6-aa8a-c9ed9a884199 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:31.632804 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-cc6cb17c-00bd-47a6-aa8a-c9ed9a884199 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:31.633357 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-cc6cb17c-00bd-47a6-aa8a-c9ed9a884199 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:31.819051 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-cc6cb17c-00bd-47a6-aa8a-c9ed9a884199 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:05:31.827217 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-cc6cb17c-00bd-47a6-aa8a-c9ed9a884199 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/24059932-87a0-4e56-8bb0-4797276e2042" status: 200 len: 1511 microversion: 2.1 time: 0.210151 May 31 21:05:31.837496 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 127/288] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:05:31 2022] GET /compute/v2.1/servers/24059932-87a0-4e56-8bb0-4797276e2042 => generated 1511 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:05:32.406051 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-39c0d12d-1685-4ac6-adc5-654ceb0dc4a1 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:05:32.406676 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-39c0d12d-1685-4ac6-adc5-654ceb0dc4a1 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:05:32.413678 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-39c0d12d-1685-4ac6-adc5-654ceb0dc4a1 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:32.414150 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-39c0d12d-1685-4ac6-adc5-654ceb0dc4a1 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:32.414929 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-39c0d12d-1685-4ac6-adc5-654ceb0dc4a1 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:32.415425 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-39c0d12d-1685-4ac6-adc5-654ceb0dc4a1 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:32.504895 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-39c0d12d-1685-4ac6-adc5-654ceb0dc4a1 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:05:32.518550 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-39c0d12d-1685-4ac6-adc5-654ceb0dc4a1 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1309 microversion: 2.1 time: 0.116708 May 31 21:05:32.520066 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 162/289] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:05:32 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1309 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:05:32.845430 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-0b095d11-5639-48ee-bac9-0419066338cb tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:05:32.846683 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-0b095d11-5639-48ee-bac9-0419066338cb tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 24059932-87a0-4e56-8bb0-4797276e2042] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:05:32.854214 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-0b095d11-5639-48ee-bac9-0419066338cb tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:32.854606 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-0b095d11-5639-48ee-bac9-0419066338cb tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:32.855434 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-0b095d11-5639-48ee-bac9-0419066338cb tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:32.855877 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-0b095d11-5639-48ee-bac9-0419066338cb tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:33.012644 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-0b095d11-5639-48ee-bac9-0419066338cb tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:05:33.028594 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-0b095d11-5639-48ee-bac9-0419066338cb tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/24059932-87a0-4e56-8bb0-4797276e2042" status: 200 len: 1511 microversion: 2.1 time: 0.187257 May 31 21:05:33.029709 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 128/290] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:05:32 2022] GET /compute/v2.1/servers/24059932-87a0-4e56-8bb0-4797276e2042 => generated 1511 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:05:33.537729 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-30c8158f-44bd-4d4f-8f7d-84f04280d931 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:05:33.538380 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-30c8158f-44bd-4d4f-8f7d-84f04280d931 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:05:33.545635 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-30c8158f-44bd-4d4f-8f7d-84f04280d931 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:33.546127 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-30c8158f-44bd-4d4f-8f7d-84f04280d931 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:33.546922 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-30c8158f-44bd-4d4f-8f7d-84f04280d931 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:33.547360 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-30c8158f-44bd-4d4f-8f7d-84f04280d931 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:33.631668 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-30c8158f-44bd-4d4f-8f7d-84f04280d931 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:05:33.642518 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-30c8158f-44bd-4d4f-8f7d-84f04280d931 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1309 microversion: 2.1 time: 0.108393 May 31 21:05:33.654715 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 163/291] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:05:33 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1309 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:05:34.053789 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-a7ba10d8-aa62-4062-bb3d-19472a0d5291 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:05:34.059519 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-a7ba10d8-aa62-4062-bb3d-19472a0d5291 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 24059932-87a0-4e56-8bb0-4797276e2042] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:05:34.074902 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a7ba10d8-aa62-4062-bb3d-19472a0d5291 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:34.075819 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a7ba10d8-aa62-4062-bb3d-19472a0d5291 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:34.077357 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a7ba10d8-aa62-4062-bb3d-19472a0d5291 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:34.078183 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a7ba10d8-aa62-4062-bb3d-19472a0d5291 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:34.311852 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-a7ba10d8-aa62-4062-bb3d-19472a0d5291 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:05:34.323433 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-a7ba10d8-aa62-4062-bb3d-19472a0d5291 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/24059932-87a0-4e56-8bb0-4797276e2042" status: 200 len: 1517 microversion: 2.1 time: 0.277283 May 31 21:05:34.324461 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 129/292] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:05:34 2022] GET /compute/v2.1/servers/24059932-87a0-4e56-8bb0-4797276e2042 => generated 1517 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:05:34.688472 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-76e0b88a-a086-4de8-abce-dfd925a70ce2 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:05:34.689669 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-76e0b88a-a086-4de8-abce-dfd925a70ce2 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:05:34.737687 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-76e0b88a-a086-4de8-abce-dfd925a70ce2 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:34.743421 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-76e0b88a-a086-4de8-abce-dfd925a70ce2 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:34.750105 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-76e0b88a-a086-4de8-abce-dfd925a70ce2 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:34.750105 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-76e0b88a-a086-4de8-abce-dfd925a70ce2 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:34.901762 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-76e0b88a-a086-4de8-abce-dfd925a70ce2 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:05:34.913013 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-76e0b88a-a086-4de8-abce-dfd925a70ce2 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1315 microversion: 2.1 time: 0.238325 May 31 21:05:34.913726 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 164/293] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:05:34 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:05:35.937407 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-740c899c-9b33-45d5-967d-4d0c171ca42a tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:05:35.938317 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-740c899c-9b33-45d5-967d-4d0c171ca42a tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:05:35.959598 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-740c899c-9b33-45d5-967d-4d0c171ca42a tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:35.966003 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-740c899c-9b33-45d5-967d-4d0c171ca42a tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:35.966003 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-740c899c-9b33-45d5-967d-4d0c171ca42a tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:35.967169 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-740c899c-9b33-45d5-967d-4d0c171ca42a tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:36.234074 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-740c899c-9b33-45d5-967d-4d0c171ca42a tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:05:36.253524 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-740c899c-9b33-45d5-967d-4d0c171ca42a tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1357 microversion: 2.1 time: 0.319735 May 31 21:05:36.264572 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 130/294] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:05:35 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1357 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:05:36.542370 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-f3ce7b48-c783-4f37-9a5e-57766e0eca45 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Action: 'create', calling method: .version_select at 0x7fe7c0ea6430>, body: {"keypair": {"name": "tempest-keypair-114727409", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJA5/JKnUmqkAk1p0DA7iQMsseC8iM17dwPZieB4PBWGzn7+bsej46GyuZcHLhVJDXYG9rSoJej50hJjqHvCnb+yGnoECBDgNXymCC1eqCuoXWxcGoI6dv1TD7VUfSBYg=="}} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:05:36.600178 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.quota [None req-f3ce7b48-c783-4f37-9a5e-57766e0eca45 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Getting quotas for project f1b54ceb69fc4041b743a11eda4144a8. Resources: {'key_pairs'} {{(pid=118184) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 21:05:36.609344 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.quota [None req-f3ce7b48-c783-4f37-9a5e-57766e0eca45 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Getting quotas for user bbf377756836405d804d2aaba6e44c1f and project f1b54ceb69fc4041b743a11eda4144a8. Resources: {'key_pairs'} {{(pid=118184) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 21:05:36.789492 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-f3ce7b48-c783-4f37-9a5e-57766e0eca45 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.252651 May 31 21:05:36.791848 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 165/295] 10.222.0.55 () {60 vars in 1158 bytes} [Tue May 31 21:05:36 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:05:37.289207 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-e2b8fd07-959d-4b86-952c-3827a680ed82 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:05:37.291571 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-e2b8fd07-959d-4b86-952c-3827a680ed82 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:05:37.300477 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e2b8fd07-959d-4b86-952c-3827a680ed82 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:37.307252 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e2b8fd07-959d-4b86-952c-3827a680ed82 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:37.307252 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e2b8fd07-959d-4b86-952c-3827a680ed82 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:37.307252 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e2b8fd07-959d-4b86-952c-3827a680ed82 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:37.655824 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-e2b8fd07-959d-4b86-952c-3827a680ed82 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:05:37.680562 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-e2b8fd07-959d-4b86-952c-3827a680ed82 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1357 microversion: 2.1 time: 0.396766 May 31 21:05:37.686944 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 131/296] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:05:37 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1357 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:05:37.695451 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [req-36fe4b5c-6ff2-4f9e-b0d7-aab60d264b7b req-50012daf-6ea3-4b67-9df4-f347dabf1877 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "979133c4-01ae-4510-8d70-018170135a6c", "tag": "6ba426b9-2ac4-463e-bc64-9ae379649087"}]} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:05:37.713069 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-36fe4b5c-6ff2-4f9e-b0d7-aab60d264b7b req-50012daf-6ea3-4b67-9df4-f347dabf1877 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:37.713806 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-36fe4b5c-6ff2-4f9e-b0d7-aab60d264b7b req-50012daf-6ea3-4b67-9df4-f347dabf1877 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:37.775283 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.compute.server_external_events [req-36fe4b5c-6ff2-4f9e-b0d7-aab60d264b7b req-50012daf-6ea3-4b67-9df4-f347dabf1877 service nova] Creating event network-changed:6ba426b9-2ac4-463e-bc64-9ae379649087 for instance 979133c4-01ae-4510-8d70-018170135a6c on hv-cinder-83979 May 31 21:05:37.802622 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [req-36fe4b5c-6ff2-4f9e-b0d7-aab60d264b7b req-50012daf-6ea3-4b67-9df4-f347dabf1877 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121490 May 31 21:05:37.813789 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 166/297] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:05:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 21:05:38.709779 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-7ed845a7-bdc8-455c-beb4-f92265bd466a tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:05:38.711274 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-7ed845a7-bdc8-455c-beb4-f92265bd466a tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:05:38.736958 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-7ed845a7-bdc8-455c-beb4-f92265bd466a tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:38.738393 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-7ed845a7-bdc8-455c-beb4-f92265bd466a tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:38.745138 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-7ed845a7-bdc8-455c-beb4-f92265bd466a tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:38.745943 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-7ed845a7-bdc8-455c-beb4-f92265bd466a tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:39.218706 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-7ed845a7-bdc8-455c-beb4-f92265bd466a tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:05:39.233038 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-7ed845a7-bdc8-455c-beb4-f92265bd466a tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1357 microversion: 2.1 time: 0.527024 May 31 21:05:39.246001 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 132/298] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:05:38 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1357 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:05:40.272381 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-397c4696-7618-46eb-997a-2465fae29fdd tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:05:40.274251 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-397c4696-7618-46eb-997a-2465fae29fdd tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:05:40.289174 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell0:SELECT=2 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:40.292353 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=4 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:40.296635 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-397c4696-7618-46eb-997a-2465fae29fdd tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:40.299982 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-397c4696-7618-46eb-997a-2465fae29fdd tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:40.302681 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-397c4696-7618-46eb-997a-2465fae29fdd tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:40.303229 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-397c4696-7618-46eb-997a-2465fae29fdd tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:40.357107 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:40.783856 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-397c4696-7618-46eb-997a-2465fae29fdd tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:05:40.801039 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-397c4696-7618-46eb-997a-2465fae29fdd tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1357 microversion: 2.1 time: 0.541934 May 31 21:05:40.802879 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 167/299] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:05:40 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1357 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:05:41.832090 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-a25a4e6f-4ad3-41d2-b748-99fadd99f23a tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:05:41.832850 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-a25a4e6f-4ad3-41d2-b748-99fadd99f23a tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:05:41.852814 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell0:SELECT=8 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:41.863029 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a25a4e6f-4ad3-41d2-b748-99fadd99f23a tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:41.863029 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a25a4e6f-4ad3-41d2-b748-99fadd99f23a tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:41.868158 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a25a4e6f-4ad3-41d2-b748-99fadd99f23a tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:41.874453 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a25a4e6f-4ad3-41d2-b748-99fadd99f23a tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:42.188801 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-a25a4e6f-4ad3-41d2-b748-99fadd99f23a tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:05:42.188801 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-a25a4e6f-4ad3-41d2-b748-99fadd99f23a tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1357 microversion: 2.1 time: 0.366989 May 31 21:05:42.188801 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 133/300] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:05:41 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1357 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:05:43.004838 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-6b0e9928-1826-4a11-9f0e-e9c21442954b tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-159176882", "imageRef": "21b89996-9e87-489d-8891-305f6c3d905a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "50707fc3-657a-4d1c-8628-0dfb2710b9bc"}], "security_groups": [{"name": "tempest-securitygroup--1213022904"}], "key_name": "tempest-keypair-114727409", "user_data": "}} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:05:43.209492 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-e564c953-6a1e-4f46-ac1d-5e560baa2b8a tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:05:43.211099 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-e564c953-6a1e-4f46-ac1d-5e560baa2b8a tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:05:43.220654 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e564c953-6a1e-4f46-ac1d-5e560baa2b8a tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:43.221523 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e564c953-6a1e-4f46-ac1d-5e560baa2b8a tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:43.223037 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e564c953-6a1e-4f46-ac1d-5e560baa2b8a tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:43.223764 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e564c953-6a1e-4f46-ac1d-5e560baa2b8a tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:43.419917 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-e564c953-6a1e-4f46-ac1d-5e560baa2b8a tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:05:43.436312 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-e564c953-6a1e-4f46-ac1d-5e560baa2b8a tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1357 microversion: 2.1 time: 0.232112 May 31 21:05:43.439104 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 134/301] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:05:43 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1357 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:05:44.459525 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-a7ab64e4-0a50-4e6c-b3eb-1d48b9bc50b7 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:05:44.460750 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-a7ab64e4-0a50-4e6c-b3eb-1d48b9bc50b7 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:05:44.479660 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a7ab64e4-0a50-4e6c-b3eb-1d48b9bc50b7 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:44.480543 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a7ab64e4-0a50-4e6c-b3eb-1d48b9bc50b7 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:44.493680 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a7ab64e4-0a50-4e6c-b3eb-1d48b9bc50b7 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:44.493680 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a7ab64e4-0a50-4e6c-b3eb-1d48b9bc50b7 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:44.757039 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-a7ab64e4-0a50-4e6c-b3eb-1d48b9bc50b7 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:05:44.767330 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-a7ab64e4-0a50-4e6c-b3eb-1d48b9bc50b7 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1357 microversion: 2.1 time: 0.311910 May 31 21:05:44.768651 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 135/302] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:05:44 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1357 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:05:45.804735 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-d4e4d406-3e08-4069-8f19-f79caebb6cf9 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:05:45.805404 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-d4e4d406-3e08-4069-8f19-f79caebb6cf9 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:05:45.813678 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-d4e4d406-3e08-4069-8f19-f79caebb6cf9 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:45.819376 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-d4e4d406-3e08-4069-8f19-f79caebb6cf9 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:45.820633 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-d4e4d406-3e08-4069-8f19-f79caebb6cf9 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:45.824192 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-d4e4d406-3e08-4069-8f19-f79caebb6cf9 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:45.858883 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell1:SELECT=100 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:46.033608 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-d4e4d406-3e08-4069-8f19-f79caebb6cf9 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:05:46.048883 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-d4e4d406-3e08-4069-8f19-f79caebb6cf9 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1357 microversion: 2.1 time: 0.248796 May 31 21:05:46.049599 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 136/303] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:05:45 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1357 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:05:46.666176 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell0:SELECT=10 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:47.067173 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-f11d1fa3-7ca5-4054-81a9-caa8b6309e40 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:05:47.068001 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-f11d1fa3-7ca5-4054-81a9-caa8b6309e40 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:05:47.099143 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f11d1fa3-7ca5-4054-81a9-caa8b6309e40 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:47.100014 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f11d1fa3-7ca5-4054-81a9-caa8b6309e40 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:47.102900 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f11d1fa3-7ca5-4054-81a9-caa8b6309e40 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:47.105086 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f11d1fa3-7ca5-4054-81a9-caa8b6309e40 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:47.383089 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-f11d1fa3-7ca5-4054-81a9-caa8b6309e40 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:05:47.392357 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-f11d1fa3-7ca5-4054-81a9-caa8b6309e40 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1357 microversion: 2.1 time: 0.329318 May 31 21:05:47.402724 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 137/304] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:05:47 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1357 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:05:48.410455 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-31961792-b975-4ca6-b51e-4640a8604b69 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:05:48.413093 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-31961792-b975-4ca6-b51e-4640a8604b69 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:05:48.421035 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-31961792-b975-4ca6-b51e-4640a8604b69 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:48.421523 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-31961792-b975-4ca6-b51e-4640a8604b69 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:48.422329 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-31961792-b975-4ca6-b51e-4640a8604b69 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:48.422767 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-31961792-b975-4ca6-b51e-4640a8604b69 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:48.618304 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-31961792-b975-4ca6-b51e-4640a8604b69 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:05:48.632614 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-31961792-b975-4ca6-b51e-4640a8604b69 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1357 microversion: 2.1 time: 0.226285 May 31 21:05:48.633257 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 138/305] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:05:48 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1357 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:05:49.466196 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.network.neutron [None req-6b0e9928-1826-4a11-9f0e-e9c21442954b tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] validate_networks() for [('50707fc3-657a-4d1c-8628-0dfb2710b9bc', None, None, None, None, None)] {{(pid=118184) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 21:05:49.660086 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-22666b53-3a4b-4380-ae3c-3e8af7517c64 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:05:49.660747 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-22666b53-3a4b-4380-ae3c-3e8af7517c64 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:05:49.669059 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-22666b53-3a4b-4380-ae3c-3e8af7517c64 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:49.669509 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-22666b53-3a4b-4380-ae3c-3e8af7517c64 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:49.670312 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-22666b53-3a4b-4380-ae3c-3e8af7517c64 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:49.670755 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-22666b53-3a4b-4380-ae3c-3e8af7517c64 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:50.050271 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-22666b53-3a4b-4380-ae3c-3e8af7517c64 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:05:50.053779 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-22666b53-3a4b-4380-ae3c-3e8af7517c64 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1357 microversion: 2.1 time: 0.397782 May 31 21:05:50.055198 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 139/306] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:05:49 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1357 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:05:50.129970 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.virt.hardware [None req-6b0e9928-1826-4a11-9f0e-e9c21442954b tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Flavor limits 0:0:0 {{(pid=118184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 21:05:50.129970 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.virt.hardware [None req-6b0e9928-1826-4a11-9f0e-e9c21442954b tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Image limits 0:0:0 {{(pid=118184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 21:05:50.129970 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.virt.hardware [None req-6b0e9928-1826-4a11-9f0e-e9c21442954b tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Flavor pref 0:0:0 {{(pid=118184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 21:05:50.129970 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.virt.hardware [None req-6b0e9928-1826-4a11-9f0e-e9c21442954b tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Image pref 0:0:0 {{(pid=118184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 21:05:50.129970 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.virt.hardware [None req-6b0e9928-1826-4a11-9f0e-e9c21442954b tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 21:05:50.140658 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6b0e9928-1826-4a11-9f0e-e9c21442954b tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:50.141164 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6b0e9928-1826-4a11-9f0e-e9c21442954b tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:50.142135 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6b0e9928-1826-4a11-9f0e-e9c21442954b tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:50.142515 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6b0e9928-1826-4a11-9f0e-e9c21442954b tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:50.162785 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.quota [None req-6b0e9928-1826-4a11-9f0e-e9c21442954b tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Getting quotas for project f1b54ceb69fc4041b743a11eda4144a8. Resources: {'ram', 'cores', 'instances'} {{(pid=118184) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 21:05:50.168063 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.quota [None req-6b0e9928-1826-4a11-9f0e-e9c21442954b tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Getting quotas for user bbf377756836405d804d2aaba6e44c1f and project f1b54ceb69fc4041b743a11eda4144a8. Resources: {'ram', 'cores', 'instances'} {{(pid=118184) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 21:05:50.181570 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-6b0e9928-1826-4a11-9f0e-e9c21442954b tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Going to run 1 instances... {{(pid=118184) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 21:05:50.184187 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-6b0e9928-1826-4a11-9f0e-e9c21442954b tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='21b89996-9e87-489d-8891-305f6c3d905a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118184) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 21:05:50.428016 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-6b0e9928-1826-4a11-9f0e-e9c21442954b tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 7.429752 May 31 21:05:50.428718 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 168/307] 10.222.0.55 () {60 vars in 1146 bytes} [Tue May 31 21:05:42 2022] POST /compute/v2.1/servers => generated 409 bytes in 7432 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 31 21:05:50.445215 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-486b4bd6-8eaa-4f58-9c4b-06e796df4324 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:05:50.445829 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-486b4bd6-8eaa-4f58-9c4b-06e796df4324 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:05:50.507193 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-486b4bd6-8eaa-4f58-9c4b-06e796df4324 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:05:50.514828 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-486b4bd6-8eaa-4f58-9c4b-06e796df4324 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1244 microversion: 2.1 time: 0.073013 May 31 21:05:50.515143 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 140/308] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:05:50 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1244 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:05:51.073219 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-c066fbbc-6600-4c46-81bd-be7e7f2e6409 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:05:51.074086 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-c066fbbc-6600-4c46-81bd-be7e7f2e6409 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:05:51.081152 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c066fbbc-6600-4c46-81bd-be7e7f2e6409 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:51.082285 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c066fbbc-6600-4c46-81bd-be7e7f2e6409 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:51.083284 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c066fbbc-6600-4c46-81bd-be7e7f2e6409 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:51.084136 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c066fbbc-6600-4c46-81bd-be7e7f2e6409 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:51.256536 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-c066fbbc-6600-4c46-81bd-be7e7f2e6409 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:05:51.268612 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-c066fbbc-6600-4c46-81bd-be7e7f2e6409 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1357 microversion: 2.1 time: 0.199168 May 31 21:05:51.270789 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 169/309] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:05:51 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1357 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:05:51.534136 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-b9f4239c-deca-49e8-9cfa-6fb09faaf624 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:05:51.535021 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-b9f4239c-deca-49e8-9cfa-6fb09faaf624 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:05:51.547989 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b9f4239c-deca-49e8-9cfa-6fb09faaf624 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:51.548842 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b9f4239c-deca-49e8-9cfa-6fb09faaf624 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:51.549855 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b9f4239c-deca-49e8-9cfa-6fb09faaf624 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:51.550480 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b9f4239c-deca-49e8-9cfa-6fb09faaf624 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:51.665659 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-b9f4239c-deca-49e8-9cfa-6fb09faaf624 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:05:51.686735 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-b9f4239c-deca-49e8-9cfa-6fb09faaf624 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1248 microversion: 2.1 time: 0.158404 May 31 21:05:51.706095 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 141/310] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:05:51 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1248 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:05:52.297797 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-3061f798-76a5-4fa9-adfd-da3baa6d1136 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:05:52.298460 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-3061f798-76a5-4fa9-adfd-da3baa6d1136 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:05:52.306287 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-3061f798-76a5-4fa9-adfd-da3baa6d1136 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:52.306944 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-3061f798-76a5-4fa9-adfd-da3baa6d1136 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:52.307555 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-3061f798-76a5-4fa9-adfd-da3baa6d1136 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:52.307994 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-3061f798-76a5-4fa9-adfd-da3baa6d1136 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:52.536386 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-3061f798-76a5-4fa9-adfd-da3baa6d1136 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:05:52.549788 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-3061f798-76a5-4fa9-adfd-da3baa6d1136 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1357 microversion: 2.1 time: 0.256046 May 31 21:05:52.551804 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 170/311] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:05:52 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1357 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:05:52.717703 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-5048223d-865e-448f-b503-0b1d8a372620 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:05:52.718526 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-5048223d-865e-448f-b503-0b1d8a372620 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:05:52.726764 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-5048223d-865e-448f-b503-0b1d8a372620 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:52.727721 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-5048223d-865e-448f-b503-0b1d8a372620 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:52.728713 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-5048223d-865e-448f-b503-0b1d8a372620 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:52.729157 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-5048223d-865e-448f-b503-0b1d8a372620 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:52.874015 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-5048223d-865e-448f-b503-0b1d8a372620 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:05:52.888792 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-5048223d-865e-448f-b503-0b1d8a372620 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1248 microversion: 2.1 time: 0.176476 May 31 21:05:52.889747 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 142/312] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:05:52 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1248 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:05:53.580061 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-0d83e7ac-b0fb-4eaa-97bb-147d5ca5b02a tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:05:53.580850 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-0d83e7ac-b0fb-4eaa-97bb-147d5ca5b02a tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:05:53.588148 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-0d83e7ac-b0fb-4eaa-97bb-147d5ca5b02a tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:53.588607 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-0d83e7ac-b0fb-4eaa-97bb-147d5ca5b02a tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:53.590099 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-0d83e7ac-b0fb-4eaa-97bb-147d5ca5b02a tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:53.590542 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-0d83e7ac-b0fb-4eaa-97bb-147d5ca5b02a tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:53.815727 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-0d83e7ac-b0fb-4eaa-97bb-147d5ca5b02a tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:05:53.825290 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-0d83e7ac-b0fb-4eaa-97bb-147d5ca5b02a tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1357 microversion: 2.1 time: 0.249261 May 31 21:05:53.833641 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 171/313] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:05:53 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1357 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:05:53.913480 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-27b05687-5a6d-42f5-9697-0e48c777f7f9 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:05:53.914047 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-27b05687-5a6d-42f5-9697-0e48c777f7f9 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:05:53.927638 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-27b05687-5a6d-42f5-9697-0e48c777f7f9 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:53.928534 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-27b05687-5a6d-42f5-9697-0e48c777f7f9 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:53.929545 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-27b05687-5a6d-42f5-9697-0e48c777f7f9 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:53.930179 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-27b05687-5a6d-42f5-9697-0e48c777f7f9 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:54.017691 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-27b05687-5a6d-42f5-9697-0e48c777f7f9 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:05:54.025804 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-27b05687-5a6d-42f5-9697-0e48c777f7f9 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1248 microversion: 2.1 time: 0.117928 May 31 21:05:54.027307 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 143/314] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:05:53 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1248 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:05:54.860544 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-22694c2d-014b-4371-ae7d-741abec13185 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:05:54.861572 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-22694c2d-014b-4371-ae7d-741abec13185 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:05:54.879819 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-22694c2d-014b-4371-ae7d-741abec13185 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:54.880590 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-22694c2d-014b-4371-ae7d-741abec13185 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:54.882053 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-22694c2d-014b-4371-ae7d-741abec13185 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:54.882819 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-22694c2d-014b-4371-ae7d-741abec13185 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:55.058764 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-2c06b1ab-10dc-4856-a6df-a664ffff656a tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:05:55.060181 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-2c06b1ab-10dc-4856-a6df-a664ffff656a tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:05:55.074159 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-2c06b1ab-10dc-4856-a6df-a664ffff656a tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:55.075338 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-2c06b1ab-10dc-4856-a6df-a664ffff656a tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:55.077023 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-2c06b1ab-10dc-4856-a6df-a664ffff656a tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:55.078127 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-2c06b1ab-10dc-4856-a6df-a664ffff656a tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:55.208342 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-2c06b1ab-10dc-4856-a6df-a664ffff656a tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:05:55.218895 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-2c06b1ab-10dc-4856-a6df-a664ffff656a tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1248 microversion: 2.1 time: 0.166929 May 31 21:05:55.231756 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 144/315] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:05:55 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1248 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:05:55.231994 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-22694c2d-014b-4371-ae7d-741abec13185 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:05:55.240621 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-22694c2d-014b-4371-ae7d-741abec13185 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1357 microversion: 2.1 time: 0.399194 May 31 21:05:55.241568 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 172/316] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:05:54 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1357 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:05:56.243074 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-7c29f71c-4f2c-4c17-8e58-a51360e61942 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:05:56.243962 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-7c29f71c-4f2c-4c17-8e58-a51360e61942 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:05:56.252252 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-7c29f71c-4f2c-4c17-8e58-a51360e61942 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:56.253158 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-7c29f71c-4f2c-4c17-8e58-a51360e61942 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:56.254034 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-7c29f71c-4f2c-4c17-8e58-a51360e61942 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:56.254477 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-7c29f71c-4f2c-4c17-8e58-a51360e61942 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:56.258468 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-15385ea9-b1e4-4a2d-8c6b-ed22fbcf58f2 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:05:56.259175 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-15385ea9-b1e4-4a2d-8c6b-ed22fbcf58f2 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:05:56.265784 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-15385ea9-b1e4-4a2d-8c6b-ed22fbcf58f2 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:56.266381 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-15385ea9-b1e4-4a2d-8c6b-ed22fbcf58f2 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:56.267198 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-15385ea9-b1e4-4a2d-8c6b-ed22fbcf58f2 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:56.267953 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-15385ea9-b1e4-4a2d-8c6b-ed22fbcf58f2 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:56.330534 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-7c29f71c-4f2c-4c17-8e58-a51360e61942 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:05:56.339931 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-7c29f71c-4f2c-4c17-8e58-a51360e61942 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1248 microversion: 2.1 time: 0.101141 May 31 21:05:56.346154 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 145/317] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:05:56 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1248 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:05:56.475514 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-15385ea9-b1e4-4a2d-8c6b-ed22fbcf58f2 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:05:56.489934 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-15385ea9-b1e4-4a2d-8c6b-ed22fbcf58f2 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1357 microversion: 2.1 time: 0.235266 May 31 21:05:56.502335 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 173/318] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:05:56 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1357 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:05:57.369080 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-16c6f65e-da32-46a9-80fe-c15c39b35027 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:05:57.372901 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-16c6f65e-da32-46a9-80fe-c15c39b35027 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:05:57.388073 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-16c6f65e-da32-46a9-80fe-c15c39b35027 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:57.389297 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-16c6f65e-da32-46a9-80fe-c15c39b35027 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:57.393146 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-16c6f65e-da32-46a9-80fe-c15c39b35027 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:57.394538 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-16c6f65e-da32-46a9-80fe-c15c39b35027 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:57.518321 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-8fb45bd6-cfcf-46fa-bd6e-d64916548c56 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:05:57.519012 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-8fb45bd6-cfcf-46fa-bd6e-d64916548c56 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:05:57.526619 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-8fb45bd6-cfcf-46fa-bd6e-d64916548c56 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:57.527589 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-8fb45bd6-cfcf-46fa-bd6e-d64916548c56 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:57.528481 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-16c6f65e-da32-46a9-80fe-c15c39b35027 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:05:57.528858 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-8fb45bd6-cfcf-46fa-bd6e-d64916548c56 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:57.529305 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-8fb45bd6-cfcf-46fa-bd6e-d64916548c56 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:57.546922 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-16c6f65e-da32-46a9-80fe-c15c39b35027 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1248 microversion: 2.1 time: 0.185478 May 31 21:05:57.549532 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 146/319] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:05:57 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1248 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:05:57.712735 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-8fb45bd6-cfcf-46fa-bd6e-d64916548c56 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:05:57.720662 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-8fb45bd6-cfcf-46fa-bd6e-d64916548c56 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1357 microversion: 2.1 time: 0.207906 May 31 21:05:57.721258 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 174/320] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:05:57 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1357 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:05:58.574879 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-6fbfc4dc-225e-45cd-95fd-0638bd5af665 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:05:58.574879 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-6fbfc4dc-225e-45cd-95fd-0638bd5af665 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:05:58.585884 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-6fbfc4dc-225e-45cd-95fd-0638bd5af665 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:58.589843 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-6fbfc4dc-225e-45cd-95fd-0638bd5af665 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:58.589843 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-6fbfc4dc-225e-45cd-95fd-0638bd5af665 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:58.589843 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-6fbfc4dc-225e-45cd-95fd-0638bd5af665 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:58.678267 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-6fbfc4dc-225e-45cd-95fd-0638bd5af665 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:05:58.692387 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-6fbfc4dc-225e-45cd-95fd-0638bd5af665 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1248 microversion: 2.1 time: 0.122338 May 31 21:05:58.692387 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 147/321] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:05:58 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1248 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:05:58.737655 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-62714efd-768a-43dc-a748-0370f5eba4fd tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:05:58.738307 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-62714efd-768a-43dc-a748-0370f5eba4fd tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:05:58.744660 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-62714efd-768a-43dc-a748-0370f5eba4fd tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:58.745159 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-62714efd-768a-43dc-a748-0370f5eba4fd tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:58.746506 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-62714efd-768a-43dc-a748-0370f5eba4fd tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:58.746947 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-62714efd-768a-43dc-a748-0370f5eba4fd tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:58.894477 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-62714efd-768a-43dc-a748-0370f5eba4fd tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:05:58.903479 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-62714efd-768a-43dc-a748-0370f5eba4fd tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1357 microversion: 2.1 time: 0.169622 May 31 21:05:58.904105 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 175/322] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:05:58 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:05:59.704773 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-c5f57708-fd78-4366-a313-632b8427fe88 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:05:59.705538 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-c5f57708-fd78-4366-a313-632b8427fe88 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:05:59.709521 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_api:SELECT=58 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:59.714979 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c5f57708-fd78-4366-a313-632b8427fe88 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:59.715425 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c5f57708-fd78-4366-a313-632b8427fe88 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:59.716208 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c5f57708-fd78-4366-a313-632b8427fe88 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:59.716642 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c5f57708-fd78-4366-a313-632b8427fe88 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:59.784496 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-c5f57708-fd78-4366-a313-632b8427fe88 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:05:59.789559 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-c5f57708-fd78-4366-a313-632b8427fe88 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1248 microversion: 2.1 time: 0.088937 May 31 21:05:59.790186 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 148/323] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:05:59 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1248 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:05:59.929869 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-15b62c1a-067c-4a97-8d5c-284030bc09e1 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:05:59.930584 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-15b62c1a-067c-4a97-8d5c-284030bc09e1 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:05:59.937428 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-15b62c1a-067c-4a97-8d5c-284030bc09e1 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:59.937882 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-15b62c1a-067c-4a97-8d5c-284030bc09e1 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:05:59.938692 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-15b62c1a-067c-4a97-8d5c-284030bc09e1 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:05:59.939127 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-15b62c1a-067c-4a97-8d5c-284030bc09e1 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:00.098009 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-15b62c1a-067c-4a97-8d5c-284030bc09e1 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:00.106097 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-15b62c1a-067c-4a97-8d5c-284030bc09e1 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1357 microversion: 2.1 time: 0.180187 May 31 21:06:00.106668 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 176/324] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:05:59 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1357 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:06:00.807093 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-bc1ef437-d0ad-4e39-93c2-da80c7640b77 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:00.807753 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-bc1ef437-d0ad-4e39-93c2-da80c7640b77 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:00.811824 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell0:SELECT=2 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:00.815362 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-bc1ef437-d0ad-4e39-93c2-da80c7640b77 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:00.815813 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-bc1ef437-d0ad-4e39-93c2-da80c7640b77 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:00.816681 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-bc1ef437-d0ad-4e39-93c2-da80c7640b77 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:00.817125 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-bc1ef437-d0ad-4e39-93c2-da80c7640b77 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:00.892797 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-bc1ef437-d0ad-4e39-93c2-da80c7640b77 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:00.900679 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-bc1ef437-d0ad-4e39-93c2-da80c7640b77 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1248 microversion: 2.1 time: 0.097405 May 31 21:06:00.905154 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 149/325] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:00 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1248 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:06:01.123756 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-ba22dd0d-7ef9-4d71-88e6-3b0cdbd5ab52 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:01.124299 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-ba22dd0d-7ef9-4d71-88e6-3b0cdbd5ab52 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:01.126193 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell0:SELECT=2 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:01.126888 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell0:SELECT=6 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:01.132087 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ba22dd0d-7ef9-4d71-88e6-3b0cdbd5ab52 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:01.132538 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ba22dd0d-7ef9-4d71-88e6-3b0cdbd5ab52 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:01.133311 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ba22dd0d-7ef9-4d71-88e6-3b0cdbd5ab52 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:01.133734 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ba22dd0d-7ef9-4d71-88e6-3b0cdbd5ab52 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:01.265330 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-ba22dd0d-7ef9-4d71-88e6-3b0cdbd5ab52 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:01.273505 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-ba22dd0d-7ef9-4d71-88e6-3b0cdbd5ab52 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1357 microversion: 2.1 time: 0.154134 May 31 21:06:01.274128 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 177/326] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:01 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:06:01.918403 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-2cec4fb0-161a-489b-9c47-38cca61ea1fd tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:01.919211 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-2cec4fb0-161a-489b-9c47-38cca61ea1fd tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:01.926444 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-2cec4fb0-161a-489b-9c47-38cca61ea1fd tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:01.926907 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-2cec4fb0-161a-489b-9c47-38cca61ea1fd tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:01.927726 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-2cec4fb0-161a-489b-9c47-38cca61ea1fd tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:01.928171 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-2cec4fb0-161a-489b-9c47-38cca61ea1fd tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:02.005033 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-2cec4fb0-161a-489b-9c47-38cca61ea1fd tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:02.014969 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-2cec4fb0-161a-489b-9c47-38cca61ea1fd tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1248 microversion: 2.1 time: 0.101382 May 31 21:06:02.015578 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 150/327] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:01 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1248 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:06:02.291570 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-86533eeb-2b86-4e30-a78a-e5eb83b43378 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:02.292936 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-86533eeb-2b86-4e30-a78a-e5eb83b43378 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:02.299667 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-86533eeb-2b86-4e30-a78a-e5eb83b43378 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:02.300119 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-86533eeb-2b86-4e30-a78a-e5eb83b43378 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:02.300922 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-86533eeb-2b86-4e30-a78a-e5eb83b43378 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:02.301356 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-86533eeb-2b86-4e30-a78a-e5eb83b43378 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:02.460519 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-86533eeb-2b86-4e30-a78a-e5eb83b43378 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:02.470181 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-86533eeb-2b86-4e30-a78a-e5eb83b43378 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1357 microversion: 2.1 time: 0.182641 May 31 21:06:02.472515 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 178/328] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:02 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1357 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:06:03.035802 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-92b18f42-cc6b-451c-b207-a7a1b169a0e8 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:03.036422 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-92b18f42-cc6b-451c-b207-a7a1b169a0e8 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:03.043807 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-92b18f42-cc6b-451c-b207-a7a1b169a0e8 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:03.044259 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-92b18f42-cc6b-451c-b207-a7a1b169a0e8 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:03.045043 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-92b18f42-cc6b-451c-b207-a7a1b169a0e8 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:03.045479 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-92b18f42-cc6b-451c-b207-a7a1b169a0e8 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:03.107769 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-92b18f42-cc6b-451c-b207-a7a1b169a0e8 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:03.115436 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-92b18f42-cc6b-451c-b207-a7a1b169a0e8 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1296 microversion: 2.1 time: 0.083600 May 31 21:06:03.116024 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 151/329] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:03 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1296 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:06:03.493263 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-3d8904a1-aaa1-4b2d-ad1d-a67d43ae5327 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:03.494091 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-3d8904a1-aaa1-4b2d-ad1d-a67d43ae5327 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:03.501756 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-3d8904a1-aaa1-4b2d-ad1d-a67d43ae5327 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:03.502295 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-3d8904a1-aaa1-4b2d-ad1d-a67d43ae5327 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:03.503127 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-3d8904a1-aaa1-4b2d-ad1d-a67d43ae5327 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:03.503560 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-3d8904a1-aaa1-4b2d-ad1d-a67d43ae5327 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:03.662024 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-3d8904a1-aaa1-4b2d-ad1d-a67d43ae5327 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:03.671005 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-3d8904a1-aaa1-4b2d-ad1d-a67d43ae5327 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1357 microversion: 2.1 time: 0.182440 May 31 21:06:03.671596 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 179/330] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:03 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1357 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:06:04.140897 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-bfc4f308-462a-424d-b2e1-cd770cd273c5 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:04.141541 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-bfc4f308-462a-424d-b2e1-cd770cd273c5 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:04.148980 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-bfc4f308-462a-424d-b2e1-cd770cd273c5 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:04.149437 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-bfc4f308-462a-424d-b2e1-cd770cd273c5 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:04.150259 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-bfc4f308-462a-424d-b2e1-cd770cd273c5 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:04.150699 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-bfc4f308-462a-424d-b2e1-cd770cd273c5 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:04.228104 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-bfc4f308-462a-424d-b2e1-cd770cd273c5 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:04.235795 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-bfc4f308-462a-424d-b2e1-cd770cd273c5 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1296 microversion: 2.1 time: 0.099327 May 31 21:06:04.236561 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 152/331] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:04 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1296 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:06:04.688728 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-8f9b61d6-a2cd-43c0-a772-f84abb723326 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:04.689332 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-8f9b61d6-a2cd-43c0-a772-f84abb723326 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:04.695715 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-8f9b61d6-a2cd-43c0-a772-f84abb723326 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:04.696161 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-8f9b61d6-a2cd-43c0-a772-f84abb723326 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:04.696932 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-8f9b61d6-a2cd-43c0-a772-f84abb723326 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:04.697390 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-8f9b61d6-a2cd-43c0-a772-f84abb723326 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:04.849364 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-8f9b61d6-a2cd-43c0-a772-f84abb723326 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:04.858453 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-8f9b61d6-a2cd-43c0-a772-f84abb723326 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1357 microversion: 2.1 time: 0.173465 May 31 21:06:04.859821 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 180/332] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:04 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1357 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:06:05.261834 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-a5c83605-8d1b-4dc0-bbba-cc1727a6160c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:05.262477 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-a5c83605-8d1b-4dc0-bbba-cc1727a6160c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:05.269413 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a5c83605-8d1b-4dc0-bbba-cc1727a6160c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:05.269964 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a5c83605-8d1b-4dc0-bbba-cc1727a6160c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:05.272054 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a5c83605-8d1b-4dc0-bbba-cc1727a6160c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:05.272508 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a5c83605-8d1b-4dc0-bbba-cc1727a6160c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:05.362334 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-a5c83605-8d1b-4dc0-bbba-cc1727a6160c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:05.373050 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-a5c83605-8d1b-4dc0-bbba-cc1727a6160c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1296 microversion: 2.1 time: 0.122219 May 31 21:06:05.373639 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 153/333] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:05 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1296 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:06:05.876075 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-72502a70-786d-4783-afb5-1f91f67328c7 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:05.877031 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-72502a70-786d-4783-afb5-1f91f67328c7 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:05.883255 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-72502a70-786d-4783-afb5-1f91f67328c7 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:05.883697 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-72502a70-786d-4783-afb5-1f91f67328c7 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:05.884468 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-72502a70-786d-4783-afb5-1f91f67328c7 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:05.884905 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-72502a70-786d-4783-afb5-1f91f67328c7 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:06.028914 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-72502a70-786d-4783-afb5-1f91f67328c7 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:06.037426 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-72502a70-786d-4783-afb5-1f91f67328c7 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1357 microversion: 2.1 time: 0.165191 May 31 21:06:06.043879 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 181/334] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:05 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1357 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:06:06.391625 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-bba10b7c-6945-46f5-ade4-8869d667955d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:06.392288 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-bba10b7c-6945-46f5-ade4-8869d667955d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:06.399336 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-bba10b7c-6945-46f5-ade4-8869d667955d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:06.399786 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-bba10b7c-6945-46f5-ade4-8869d667955d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:06.400555 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-bba10b7c-6945-46f5-ade4-8869d667955d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:06.400987 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-bba10b7c-6945-46f5-ade4-8869d667955d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:06.405203 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell1:SELECT=100 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:06.467068 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-bba10b7c-6945-46f5-ade4-8869d667955d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:06.477089 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-bba10b7c-6945-46f5-ade4-8869d667955d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1296 microversion: 2.1 time: 0.089961 May 31 21:06:06.477960 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 154/335] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:06 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1296 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:06:07.060685 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-5b72ff52-3fc4-4c18-a33b-9d505e26c2fe tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:07.061296 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-5b72ff52-3fc4-4c18-a33b-9d505e26c2fe tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:07.068080 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5b72ff52-3fc4-4c18-a33b-9d505e26c2fe tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:07.068561 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5b72ff52-3fc4-4c18-a33b-9d505e26c2fe tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:07.069355 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5b72ff52-3fc4-4c18-a33b-9d505e26c2fe tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:07.069794 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5b72ff52-3fc4-4c18-a33b-9d505e26c2fe tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:07.238212 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-5b72ff52-3fc4-4c18-a33b-9d505e26c2fe tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:07.246654 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-5b72ff52-3fc4-4c18-a33b-9d505e26c2fe tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1357 microversion: 2.1 time: 0.190156 May 31 21:06:07.247225 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 182/336] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:07 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1357 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:06:07.495244 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-cd6c57d9-a281-4382-9933-d005b7ffac57 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:07.495835 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-cd6c57d9-a281-4382-9933-d005b7ffac57 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:07.503474 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-cd6c57d9-a281-4382-9933-d005b7ffac57 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:07.503921 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-cd6c57d9-a281-4382-9933-d005b7ffac57 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:07.504688 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-cd6c57d9-a281-4382-9933-d005b7ffac57 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:07.505122 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-cd6c57d9-a281-4382-9933-d005b7ffac57 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:07.583094 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-cd6c57d9-a281-4382-9933-d005b7ffac57 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:07.591887 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-cd6c57d9-a281-4382-9933-d005b7ffac57 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1304 microversion: 2.1 time: 0.100867 May 31 21:06:07.592490 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 155/337] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:07 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:06:08.264994 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-5590fc93-85e5-415c-aa37-73d695f24bb0 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:08.265649 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-5590fc93-85e5-415c-aa37-73d695f24bb0 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:08.272349 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5590fc93-85e5-415c-aa37-73d695f24bb0 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:08.272869 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5590fc93-85e5-415c-aa37-73d695f24bb0 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:08.273741 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5590fc93-85e5-415c-aa37-73d695f24bb0 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:08.274306 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5590fc93-85e5-415c-aa37-73d695f24bb0 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:08.443889 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-5590fc93-85e5-415c-aa37-73d695f24bb0 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:08.452384 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-5590fc93-85e5-415c-aa37-73d695f24bb0 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1357 microversion: 2.1 time: 0.192104 May 31 21:06:08.453053 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 183/338] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:08 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1357 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:06:08.610080 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-c8aa6c18-c692-445b-a8eb-7c60246e6b2d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:08.610683 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-c8aa6c18-c692-445b-a8eb-7c60246e6b2d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:08.617570 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c8aa6c18-c692-445b-a8eb-7c60246e6b2d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:08.618072 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c8aa6c18-c692-445b-a8eb-7c60246e6b2d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:08.618862 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c8aa6c18-c692-445b-a8eb-7c60246e6b2d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:08.619298 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c8aa6c18-c692-445b-a8eb-7c60246e6b2d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:08.693075 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-c8aa6c18-c692-445b-a8eb-7c60246e6b2d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:08.707228 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-c8aa6c18-c692-445b-a8eb-7c60246e6b2d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1304 microversion: 2.1 time: 0.100333 May 31 21:06:08.708260 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 156/339] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:08 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:06:09.469592 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-8071c4cd-def0-4657-a653-d18390e6bd04 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:09.470398 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-8071c4cd-def0-4657-a653-d18390e6bd04 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:09.476751 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-8071c4cd-def0-4657-a653-d18390e6bd04 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:09.477282 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-8071c4cd-def0-4657-a653-d18390e6bd04 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:09.478216 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-8071c4cd-def0-4657-a653-d18390e6bd04 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:09.478734 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-8071c4cd-def0-4657-a653-d18390e6bd04 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:09.638544 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-8071c4cd-def0-4657-a653-d18390e6bd04 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:09.643064 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell1:SELECT=100 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:09.647659 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-8071c4cd-def0-4657-a653-d18390e6bd04 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1357 microversion: 2.1 time: 0.181881 May 31 21:06:09.648244 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 184/340] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:09 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1357 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:06:09.736433 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-cb875a35-ca2d-4f7e-9d21-a6525ae2d5d3 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:09.737547 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-cb875a35-ca2d-4f7e-9d21-a6525ae2d5d3 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:09.748315 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-cb875a35-ca2d-4f7e-9d21-a6525ae2d5d3 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:09.749100 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-cb875a35-ca2d-4f7e-9d21-a6525ae2d5d3 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:09.750475 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-cb875a35-ca2d-4f7e-9d21-a6525ae2d5d3 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:09.751280 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-cb875a35-ca2d-4f7e-9d21-a6525ae2d5d3 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:09.820643 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-cb875a35-ca2d-4f7e-9d21-a6525ae2d5d3 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:09.828945 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-cb875a35-ca2d-4f7e-9d21-a6525ae2d5d3 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1304 microversion: 2.1 time: 0.099606 May 31 21:06:09.829529 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 157/341] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:09 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:06:10.666514 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-4e2d6505-045e-4b9a-a1e2-3bf7244a3a33 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:10.667687 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-4e2d6505-045e-4b9a-a1e2-3bf7244a3a33 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:10.674845 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4e2d6505-045e-4b9a-a1e2-3bf7244a3a33 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:10.675290 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4e2d6505-045e-4b9a-a1e2-3bf7244a3a33 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:10.676084 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4e2d6505-045e-4b9a-a1e2-3bf7244a3a33 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:10.676516 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4e2d6505-045e-4b9a-a1e2-3bf7244a3a33 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:10.846862 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-2e2e46aa-44bf-46cb-a6fe-c8227172ec75 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:10.847478 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-2e2e46aa-44bf-46cb-a6fe-c8227172ec75 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:10.854350 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-2e2e46aa-44bf-46cb-a6fe-c8227172ec75 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:10.855373 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-2e2e46aa-44bf-46cb-a6fe-c8227172ec75 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:10.856159 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-2e2e46aa-44bf-46cb-a6fe-c8227172ec75 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:10.856592 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-2e2e46aa-44bf-46cb-a6fe-c8227172ec75 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:10.869516 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-4e2d6505-045e-4b9a-a1e2-3bf7244a3a33 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:10.879212 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-4e2d6505-045e-4b9a-a1e2-3bf7244a3a33 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1357 microversion: 2.1 time: 0.216791 May 31 21:06:10.880075 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 185/342] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:10 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1357 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:06:10.930177 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-2e2e46aa-44bf-46cb-a6fe-c8227172ec75 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:10.941996 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-2e2e46aa-44bf-46cb-a6fe-c8227172ec75 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1314 microversion: 2.1 time: 0.098897 May 31 21:06:10.942706 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 158/343] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:10 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1314 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:06:11.902702 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-76ead4fd-6577-471a-89b3-20ef343d401b tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:11.902702 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-76ead4fd-6577-471a-89b3-20ef343d401b tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:11.905061 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-76ead4fd-6577-471a-89b3-20ef343d401b tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:11.905579 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-76ead4fd-6577-471a-89b3-20ef343d401b tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:11.906469 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-76ead4fd-6577-471a-89b3-20ef343d401b tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:11.906998 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-76ead4fd-6577-471a-89b3-20ef343d401b tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:11.960011 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-7b538cb8-58fd-44cd-8d35-7d891c27cad9 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:11.960911 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-7b538cb8-58fd-44cd-8d35-7d891c27cad9 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:11.970066 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-7b538cb8-58fd-44cd-8d35-7d891c27cad9 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:11.970518 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-7b538cb8-58fd-44cd-8d35-7d891c27cad9 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:11.971366 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-7b538cb8-58fd-44cd-8d35-7d891c27cad9 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:11.971804 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-7b538cb8-58fd-44cd-8d35-7d891c27cad9 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:12.058054 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-7b538cb8-58fd-44cd-8d35-7d891c27cad9 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:12.066696 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-7b538cb8-58fd-44cd-8d35-7d891c27cad9 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1302 microversion: 2.1 time: 0.110826 May 31 21:06:12.067306 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 159/344] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:11 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1302 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:06:12.104653 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-76ead4fd-6577-471a-89b3-20ef343d401b tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:12.113078 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-76ead4fd-6577-471a-89b3-20ef343d401b tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1357 microversion: 2.1 time: 0.219943 May 31 21:06:12.113735 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 186/345] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:11 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1357 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:06:13.091625 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-e46de8ee-457a-4d61-921f-021057b8c359 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:13.098371 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-e46de8ee-457a-4d61-921f-021057b8c359 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:13.105349 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e46de8ee-457a-4d61-921f-021057b8c359 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:13.105971 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e46de8ee-457a-4d61-921f-021057b8c359 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:13.107191 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e46de8ee-457a-4d61-921f-021057b8c359 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:13.107625 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e46de8ee-457a-4d61-921f-021057b8c359 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:13.135067 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-924cc215-45f6-4d16-b8a2-e364f781807a tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:13.137002 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-924cc215-45f6-4d16-b8a2-e364f781807a tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:13.151898 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-924cc215-45f6-4d16-b8a2-e364f781807a tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:13.152343 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-924cc215-45f6-4d16-b8a2-e364f781807a tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:13.156363 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-924cc215-45f6-4d16-b8a2-e364f781807a tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:13.156363 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-924cc215-45f6-4d16-b8a2-e364f781807a tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:13.368045 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-e46de8ee-457a-4d61-921f-021057b8c359 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:13.389834 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-e46de8ee-457a-4d61-921f-021057b8c359 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1370 microversion: 2.1 time: 0.301229 May 31 21:06:13.389834 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 160/346] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:13 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1370 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:06:13.404986 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-924cc215-45f6-4d16-b8a2-e364f781807a tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:13.423675 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-924cc215-45f6-4d16-b8a2-e364f781807a tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1357 microversion: 2.1 time: 0.295644 May 31 21:06:13.424720 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 187/347] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:13 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1357 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:06:13.500947 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [req-2dba48a5-7cf0-473e-82a0-c9c990195ca5 req-4f2975be-0c74-4a8d-b617-4af0a7a69405 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff87c7f6-31a7-4836-be01-c23f9c73629f", "tag": "f7d9ea30-c776-41ba-8cc7-b1d9dce9aa77"}]} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:06:13.536574 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-2dba48a5-7cf0-473e-82a0-c9c990195ca5 req-4f2975be-0c74-4a8d-b617-4af0a7a69405 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:13.537302 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-2dba48a5-7cf0-473e-82a0-c9c990195ca5 req-4f2975be-0c74-4a8d-b617-4af0a7a69405 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:13.566196 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.compute.server_external_events [req-2dba48a5-7cf0-473e-82a0-c9c990195ca5 req-4f2975be-0c74-4a8d-b617-4af0a7a69405 service nova] Creating event network-changed:f7d9ea30-c776-41ba-8cc7-b1d9dce9aa77 for instance ff87c7f6-31a7-4836-be01-c23f9c73629f on hv-cinder-83979 May 31 21:06:13.585695 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [req-2dba48a5-7cf0-473e-82a0-c9c990195ca5 req-4f2975be-0c74-4a8d-b617-4af0a7a69405 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100771 May 31 21:06:13.586716 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 161/348] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:06:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:06:14.324890 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [req-38772c76-2468-4385-9518-2e6feddd3d70 req-df4f7307-a67b-4ec9-939f-8697d1503a8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "979133c4-01ae-4510-8d70-018170135a6c", "name": "network-vif-plugged", "status": "completed", "tag": "6ba426b9-2ac4-463e-bc64-9ae379649087"}]} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:06:14.334468 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-38772c76-2468-4385-9518-2e6feddd3d70 req-df4f7307-a67b-4ec9-939f-8697d1503a8d service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:14.334906 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-38772c76-2468-4385-9518-2e6feddd3d70 req-df4f7307-a67b-4ec9-939f-8697d1503a8d service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:14.346906 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.compute.server_external_events [req-38772c76-2468-4385-9518-2e6feddd3d70 req-df4f7307-a67b-4ec9-939f-8697d1503a8d service nova] Creating event network-vif-plugged:6ba426b9-2ac4-463e-bc64-9ae379649087 for instance 979133c4-01ae-4510-8d70-018170135a6c on hv-cinder-83979 May 31 21:06:14.352687 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [req-38772c76-2468-4385-9518-2e6feddd3d70 req-df4f7307-a67b-4ec9-939f-8697d1503a8d service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033015 May 31 21:06:14.353218 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 188/349] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 21:06:14.406689 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-c63d51f5-7b92-41cf-b8cb-9aec17721d0c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:14.407469 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-c63d51f5-7b92-41cf-b8cb-9aec17721d0c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:14.414493 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c63d51f5-7b92-41cf-b8cb-9aec17721d0c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:14.415020 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c63d51f5-7b92-41cf-b8cb-9aec17721d0c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:14.415802 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c63d51f5-7b92-41cf-b8cb-9aec17721d0c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:14.416234 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c63d51f5-7b92-41cf-b8cb-9aec17721d0c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:14.448831 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-f128ecb9-c18f-42ca-a311-462db5b76384 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:14.450234 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-f128ecb9-c18f-42ca-a311-462db5b76384 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:14.467988 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f128ecb9-c18f-42ca-a311-462db5b76384 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:14.467988 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f128ecb9-c18f-42ca-a311-462db5b76384 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:14.467988 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f128ecb9-c18f-42ca-a311-462db5b76384 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:14.467988 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f128ecb9-c18f-42ca-a311-462db5b76384 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:14.645167 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-c63d51f5-7b92-41cf-b8cb-9aec17721d0c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:14.654413 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-c63d51f5-7b92-41cf-b8cb-9aec17721d0c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1370 microversion: 2.1 time: 0.252945 May 31 21:06:14.655009 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 162/350] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:14 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1370 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:06:14.687353 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-f128ecb9-c18f-42ca-a311-462db5b76384 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:14.695440 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-f128ecb9-c18f-42ca-a311-462db5b76384 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1357 microversion: 2.1 time: 0.256335 May 31 21:06:14.696030 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 189/351] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:14 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1357 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:06:15.681989 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-d601964a-b1f1-4734-891f-74593404a8c4 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:15.684286 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-d601964a-b1f1-4734-891f-74593404a8c4 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:15.699597 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-d601964a-b1f1-4734-891f-74593404a8c4 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:15.700655 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-d601964a-b1f1-4734-891f-74593404a8c4 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:15.702045 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-d601964a-b1f1-4734-891f-74593404a8c4 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:15.702936 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-d601964a-b1f1-4734-891f-74593404a8c4 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:15.728257 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-0c5a6a27-715b-4b4e-a2c6-ad9cffd932ee tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:15.731708 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-0c5a6a27-715b-4b4e-a2c6-ad9cffd932ee tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:15.740827 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:15.747819 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-0c5a6a27-715b-4b4e-a2c6-ad9cffd932ee tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:15.748405 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-0c5a6a27-715b-4b4e-a2c6-ad9cffd932ee tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:15.750221 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-0c5a6a27-715b-4b4e-a2c6-ad9cffd932ee tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:15.750892 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-0c5a6a27-715b-4b4e-a2c6-ad9cffd932ee tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:16.004464 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-d601964a-b1f1-4734-891f-74593404a8c4 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:16.013598 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-0c5a6a27-715b-4b4e-a2c6-ad9cffd932ee tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:16.028531 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-d601964a-b1f1-4734-891f-74593404a8c4 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1370 microversion: 2.1 time: 0.350866 May 31 21:06:16.028531 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 163/352] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:15 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1370 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:06:16.035439 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-0c5a6a27-715b-4b4e-a2c6-ad9cffd932ee tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1357 microversion: 2.1 time: 0.315104 May 31 21:06:16.036287 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 190/353] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:15 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1357 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:06:17.043401 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-55337cc4-d25a-4021-8440-ca0274137143 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:17.044490 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-55337cc4-d25a-4021-8440-ca0274137143 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:17.056979 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-0e772adc-06fa-4c1f-ac2b-5e04c83d2a24 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:17.062668 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-0e772adc-06fa-4c1f-ac2b-5e04c83d2a24 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:17.080196 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-0e772adc-06fa-4c1f-ac2b-5e04c83d2a24 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:17.080999 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-0e772adc-06fa-4c1f-ac2b-5e04c83d2a24 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:17.082720 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-0e772adc-06fa-4c1f-ac2b-5e04c83d2a24 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:17.083554 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-0e772adc-06fa-4c1f-ac2b-5e04c83d2a24 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:17.086674 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-55337cc4-d25a-4021-8440-ca0274137143 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:17.087131 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-55337cc4-d25a-4021-8440-ca0274137143 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:17.088212 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-55337cc4-d25a-4021-8440-ca0274137143 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:17.088661 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-55337cc4-d25a-4021-8440-ca0274137143 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:17.308417 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-55337cc4-d25a-4021-8440-ca0274137143 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:17.316229 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-55337cc4-d25a-4021-8440-ca0274137143 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1370 microversion: 2.1 time: 0.279877 May 31 21:06:17.316815 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 164/354] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:17 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1370 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:06:17.317335 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-0e772adc-06fa-4c1f-ac2b-5e04c83d2a24 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:17.325788 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-0e772adc-06fa-4c1f-ac2b-5e04c83d2a24 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1357 microversion: 2.1 time: 0.275744 May 31 21:06:17.326558 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 191/355] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:17 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1357 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:06:18.335828 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-ba3c7c4b-1612-4f3f-95b4-3124ba4b2c65 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:18.336392 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-ba3c7c4b-1612-4f3f-95b4-3124ba4b2c65 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:18.343852 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ba3c7c4b-1612-4f3f-95b4-3124ba4b2c65 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:18.344295 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ba3c7c4b-1612-4f3f-95b4-3124ba4b2c65 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:18.345074 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ba3c7c4b-1612-4f3f-95b4-3124ba4b2c65 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:18.345371 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-2abf6a54-cc7a-4509-b1e4-d87d8e7bba02 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:18.345868 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ba3c7c4b-1612-4f3f-95b4-3124ba4b2c65 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:18.346092 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-2abf6a54-cc7a-4509-b1e4-d87d8e7bba02 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:18.352639 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2abf6a54-cc7a-4509-b1e4-d87d8e7bba02 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:18.353092 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2abf6a54-cc7a-4509-b1e4-d87d8e7bba02 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:18.353888 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2abf6a54-cc7a-4509-b1e4-d87d8e7bba02 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:18.354356 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2abf6a54-cc7a-4509-b1e4-d87d8e7bba02 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:18.560669 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-ba3c7c4b-1612-4f3f-95b4-3124ba4b2c65 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:18.569723 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-ba3c7c4b-1612-4f3f-95b4-3124ba4b2c65 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1370 microversion: 2.1 time: 0.238035 May 31 21:06:18.570834 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 165/356] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:18 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1370 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:06:18.573398 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-2abf6a54-cc7a-4509-b1e4-d87d8e7bba02 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:18.581337 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-2abf6a54-cc7a-4509-b1e4-d87d8e7bba02 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1357 microversion: 2.1 time: 0.239900 May 31 21:06:18.582561 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 192/357] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:18 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1357 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:06:19.596845 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-bda57e61-448a-45dd-b67d-2133151dc7b1 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:19.597451 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-bda57e61-448a-45dd-b67d-2133151dc7b1 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:19.603158 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-9e728bfd-852a-4540-94e5-9be47ec3843a tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:19.603766 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-9e728bfd-852a-4540-94e5-9be47ec3843a tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:19.604364 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-bda57e61-448a-45dd-b67d-2133151dc7b1 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:19.605367 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-bda57e61-448a-45dd-b67d-2133151dc7b1 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:19.606228 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-bda57e61-448a-45dd-b67d-2133151dc7b1 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:19.606672 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-bda57e61-448a-45dd-b67d-2133151dc7b1 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:19.610527 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-9e728bfd-852a-4540-94e5-9be47ec3843a tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:19.610973 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-9e728bfd-852a-4540-94e5-9be47ec3843a tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:19.611748 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-9e728bfd-852a-4540-94e5-9be47ec3843a tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:19.612183 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-9e728bfd-852a-4540-94e5-9be47ec3843a tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:19.819845 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-bda57e61-448a-45dd-b67d-2133151dc7b1 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:19.824415 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-9e728bfd-852a-4540-94e5-9be47ec3843a tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:19.832998 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-9e728bfd-852a-4540-94e5-9be47ec3843a tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1357 microversion: 2.1 time: 0.234089 May 31 21:06:19.833594 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 193/358] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:19 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1357 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:06:19.835605 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-bda57e61-448a-45dd-b67d-2133151dc7b1 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1370 microversion: 2.1 time: 0.242337 May 31 21:06:19.836605 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 166/359] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:19 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1370 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:06:20.851366 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-12b76025-8d11-4644-a167-223a77fb8dcf tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:20.851843 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-12b76025-8d11-4644-a167-223a77fb8dcf tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:20.861687 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-12b76025-8d11-4644-a167-223a77fb8dcf tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:20.862566 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-12b76025-8d11-4644-a167-223a77fb8dcf tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:20.863908 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-12b76025-8d11-4644-a167-223a77fb8dcf tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:20.864677 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-12b76025-8d11-4644-a167-223a77fb8dcf tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:20.864897 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-5ec7633b-3056-4b1f-8a86-c95d1981d1c2 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:20.866159 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-5ec7633b-3056-4b1f-8a86-c95d1981d1c2 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:20.880185 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-5ec7633b-3056-4b1f-8a86-c95d1981d1c2 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:20.885081 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-5ec7633b-3056-4b1f-8a86-c95d1981d1c2 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:20.885081 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-5ec7633b-3056-4b1f-8a86-c95d1981d1c2 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:20.885081 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-5ec7633b-3056-4b1f-8a86-c95d1981d1c2 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:21.102514 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-12b76025-8d11-4644-a167-223a77fb8dcf tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:21.107465 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-5ec7633b-3056-4b1f-8a86-c95d1981d1c2 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:21.115151 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-12b76025-8d11-4644-a167-223a77fb8dcf tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1357 microversion: 2.1 time: 0.267802 May 31 21:06:21.118136 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 194/360] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:20 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1357 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:06:21.121047 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-5ec7633b-3056-4b1f-8a86-c95d1981d1c2 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1370 microversion: 2.1 time: 0.264110 May 31 21:06:21.122143 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 167/361] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:20 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1370 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:06:22.141138 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-1e438007-4617-4ef1-a4fb-cc4ed60702fe tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:22.141843 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-1e438007-4617-4ef1-a4fb-cc4ed60702fe tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:22.142778 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-bb9df02e-c793-42c7-8218-3e90c1864fc6 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:22.143393 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-bb9df02e-c793-42c7-8218-3e90c1864fc6 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:22.148292 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-1e438007-4617-4ef1-a4fb-cc4ed60702fe tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:22.148874 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-1e438007-4617-4ef1-a4fb-cc4ed60702fe tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:22.149502 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-1e438007-4617-4ef1-a4fb-cc4ed60702fe tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:22.149957 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-1e438007-4617-4ef1-a4fb-cc4ed60702fe tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:22.154262 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-bb9df02e-c793-42c7-8218-3e90c1864fc6 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:22.154964 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-bb9df02e-c793-42c7-8218-3e90c1864fc6 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:22.155947 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-bb9df02e-c793-42c7-8218-3e90c1864fc6 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:22.156700 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-bb9df02e-c793-42c7-8218-3e90c1864fc6 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:22.377739 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-bb9df02e-c793-42c7-8218-3e90c1864fc6 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:22.379562 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-1e438007-4617-4ef1-a4fb-cc4ed60702fe tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:22.386681 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-bb9df02e-c793-42c7-8218-3e90c1864fc6 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1370 microversion: 2.1 time: 0.248319 May 31 21:06:22.396198 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 168/362] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:22 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1370 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:06:22.396654 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-1e438007-4617-4ef1-a4fb-cc4ed60702fe tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1357 microversion: 2.1 time: 0.251475 May 31 21:06:22.396654 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 195/363] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:22 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1357 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:06:23.411038 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-d49962a3-5f63-4089-9b5d-727b923cbf29 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:23.412828 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-13c01d89-9866-4925-ada9-3d28e3760a7e tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:23.413425 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-d49962a3-5f63-4089-9b5d-727b923cbf29 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:23.414682 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-13c01d89-9866-4925-ada9-3d28e3760a7e tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:23.429774 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-13c01d89-9866-4925-ada9-3d28e3760a7e tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:23.431937 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-d49962a3-5f63-4089-9b5d-727b923cbf29 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:23.432511 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-13c01d89-9866-4925-ada9-3d28e3760a7e tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:23.433583 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-d49962a3-5f63-4089-9b5d-727b923cbf29 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:23.435817 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-d49962a3-5f63-4089-9b5d-727b923cbf29 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:23.436163 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-13c01d89-9866-4925-ada9-3d28e3760a7e tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:23.436815 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-13c01d89-9866-4925-ada9-3d28e3760a7e tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:23.441918 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-d49962a3-5f63-4089-9b5d-727b923cbf29 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:23.686762 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-d49962a3-5f63-4089-9b5d-727b923cbf29 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:23.703690 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-d49962a3-5f63-4089-9b5d-727b923cbf29 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1370 microversion: 2.1 time: 0.296290 May 31 21:06:23.704802 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-13c01d89-9866-4925-ada9-3d28e3760a7e tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:23.705654 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 169/364] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:23 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1370 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:06:23.719264 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-13c01d89-9866-4925-ada9-3d28e3760a7e tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1357 microversion: 2.1 time: 0.317501 May 31 21:06:23.720422 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 196/365] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:23 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1357 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:06:24.727084 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-3b1d5a3d-e833-4091-8384-fdef38fe7e55 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:24.729117 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-3b1d5a3d-e833-4091-8384-fdef38fe7e55 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:24.744688 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-3b1d5a3d-e833-4091-8384-fdef38fe7e55 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:24.745350 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-3b1d5a3d-e833-4091-8384-fdef38fe7e55 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:24.747358 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-3b1d5a3d-e833-4091-8384-fdef38fe7e55 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:24.747486 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-ec79271a-ca42-45c4-9572-45ebf290d012 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:24.748156 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-3b1d5a3d-e833-4091-8384-fdef38fe7e55 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:24.748274 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-ec79271a-ca42-45c4-9572-45ebf290d012 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:24.755306 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ec79271a-ca42-45c4-9572-45ebf290d012 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:24.755757 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ec79271a-ca42-45c4-9572-45ebf290d012 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:24.756596 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ec79271a-ca42-45c4-9572-45ebf290d012 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:24.757229 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ec79271a-ca42-45c4-9572-45ebf290d012 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:25.263721 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-ec79271a-ca42-45c4-9572-45ebf290d012 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:25.269641 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-3b1d5a3d-e833-4091-8384-fdef38fe7e55 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:25.271812 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-ec79271a-ca42-45c4-9572-45ebf290d012 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1357 microversion: 2.1 time: 0.529499 May 31 21:06:25.272596 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 197/366] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:24 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1357 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:06:25.279512 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-3b1d5a3d-e833-4091-8384-fdef38fe7e55 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1370 microversion: 2.1 time: 0.560574 May 31 21:06:25.280105 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 170/367] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:24 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1370 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:06:26.290512 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-8af4bfab-a163-40cc-98a2-acace1105e21 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:26.291120 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-8af4bfab-a163-40cc-98a2-acace1105e21 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:26.300630 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-8c2a6f97-bfc6-4f79-9a56-22a0fe97ee3f tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:26.301295 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-8c2a6f97-bfc6-4f79-9a56-22a0fe97ee3f tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:26.302644 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-8af4bfab-a163-40cc-98a2-acace1105e21 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:26.304564 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-8af4bfab-a163-40cc-98a2-acace1105e21 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:26.306005 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-8af4bfab-a163-40cc-98a2-acace1105e21 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:26.306461 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-8af4bfab-a163-40cc-98a2-acace1105e21 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:26.307850 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-8c2a6f97-bfc6-4f79-9a56-22a0fe97ee3f tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:26.308256 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-8c2a6f97-bfc6-4f79-9a56-22a0fe97ee3f tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:26.309152 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-8c2a6f97-bfc6-4f79-9a56-22a0fe97ee3f tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:26.309595 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-8c2a6f97-bfc6-4f79-9a56-22a0fe97ee3f tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:26.336622 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell1:SELECT=100 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:26.543415 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-8c2a6f97-bfc6-4f79-9a56-22a0fe97ee3f tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:26.553474 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-8af4bfab-a163-40cc-98a2-acace1105e21 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:26.554341 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-8c2a6f97-bfc6-4f79-9a56-22a0fe97ee3f tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1370 microversion: 2.1 time: 0.256385 May 31 21:06:26.554479 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-8af4bfab-a163-40cc-98a2-acace1105e21 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1357 microversion: 2.1 time: 0.267975 May 31 21:06:26.555304 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 198/368] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:26 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1357 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:06:26.562123 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 171/369] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:26 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1370 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:06:27.571756 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-f4af91f5-fd8e-4fcb-8fc3-1173e207bd57 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:27.572264 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-e806033d-2372-4c84-845c-956a6f4259bd tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:27.572638 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-f4af91f5-fd8e-4fcb-8fc3-1173e207bd57 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:27.572866 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-e806033d-2372-4c84-845c-956a6f4259bd tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:27.579974 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f4af91f5-fd8e-4fcb-8fc3-1173e207bd57 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:27.580191 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e806033d-2372-4c84-845c-956a6f4259bd tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:27.580647 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f4af91f5-fd8e-4fcb-8fc3-1173e207bd57 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:27.580808 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e806033d-2372-4c84-845c-956a6f4259bd tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:27.581557 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f4af91f5-fd8e-4fcb-8fc3-1173e207bd57 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:27.581679 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e806033d-2372-4c84-845c-956a6f4259bd tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:27.582106 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f4af91f5-fd8e-4fcb-8fc3-1173e207bd57 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:27.582246 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e806033d-2372-4c84-845c-956a6f4259bd tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:27.843084 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-f4af91f5-fd8e-4fcb-8fc3-1173e207bd57 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:27.850109 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-e806033d-2372-4c84-845c-956a6f4259bd tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:27.852666 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-f4af91f5-fd8e-4fcb-8fc3-1173e207bd57 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1370 microversion: 2.1 time: 0.284924 May 31 21:06:27.858324 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 199/370] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:27 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1370 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:06:27.875883 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-e806033d-2372-4c84-845c-956a6f4259bd tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1357 microversion: 2.1 time: 0.307678 May 31 21:06:27.877083 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 172/371] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:27 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1357 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:06:28.875381 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-1c93fa87-4336-4ba0-a961-e29883867cd3 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:28.875995 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-1c93fa87-4336-4ba0-a961-e29883867cd3 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:28.882568 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-1c93fa87-4336-4ba0-a961-e29883867cd3 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:28.883021 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-1c93fa87-4336-4ba0-a961-e29883867cd3 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:28.883820 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-1c93fa87-4336-4ba0-a961-e29883867cd3 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:28.884270 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-1c93fa87-4336-4ba0-a961-e29883867cd3 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:28.904956 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-99d748dd-c0cd-4a6c-8bd7-1e1dff8a2148 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:28.906162 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-99d748dd-c0cd-4a6c-8bd7-1e1dff8a2148 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:28.918493 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-99d748dd-c0cd-4a6c-8bd7-1e1dff8a2148 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:28.924195 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-99d748dd-c0cd-4a6c-8bd7-1e1dff8a2148 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:28.925173 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-99d748dd-c0cd-4a6c-8bd7-1e1dff8a2148 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:28.925619 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-99d748dd-c0cd-4a6c-8bd7-1e1dff8a2148 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:29.161365 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-1c93fa87-4336-4ba0-a961-e29883867cd3 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:29.171356 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-99d748dd-c0cd-4a6c-8bd7-1e1dff8a2148 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:29.172708 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-1c93fa87-4336-4ba0-a961-e29883867cd3 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1370 microversion: 2.1 time: 0.301800 May 31 21:06:29.173331 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 200/372] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:28 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1370 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:06:29.192765 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-99d748dd-c0cd-4a6c-8bd7-1e1dff8a2148 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1357 microversion: 2.1 time: 0.295223 May 31 21:06:29.193402 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 173/373] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:28 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1357 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:06:30.197087 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-6a281265-f921-4440-b668-659bc11b94ed tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:30.197856 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-6a281265-f921-4440-b668-659bc11b94ed tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:30.205296 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6a281265-f921-4440-b668-659bc11b94ed tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:30.205933 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6a281265-f921-4440-b668-659bc11b94ed tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:30.206750 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6a281265-f921-4440-b668-659bc11b94ed tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:30.207186 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6a281265-f921-4440-b668-659bc11b94ed tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:30.211722 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-eaa6fb19-5c9c-4d49-a32c-421796e948b0 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:30.212855 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-eaa6fb19-5c9c-4d49-a32c-421796e948b0 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:30.217798 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_api:SELECT=52 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:30.222591 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-eaa6fb19-5c9c-4d49-a32c-421796e948b0 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:30.223121 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-eaa6fb19-5c9c-4d49-a32c-421796e948b0 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:30.223983 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-eaa6fb19-5c9c-4d49-a32c-421796e948b0 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:30.224609 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-eaa6fb19-5c9c-4d49-a32c-421796e948b0 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:30.567199 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-6a281265-f921-4440-b668-659bc11b94ed tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:30.577846 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-eaa6fb19-5c9c-4d49-a32c-421796e948b0 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:30.579635 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-6a281265-f921-4440-b668-659bc11b94ed tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1370 microversion: 2.1 time: 0.386448 May 31 21:06:30.581307 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 201/374] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:30 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1370 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:06:30.593679 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-eaa6fb19-5c9c-4d49-a32c-421796e948b0 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1357 microversion: 2.1 time: 0.385817 May 31 21:06:30.594826 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 174/375] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:30 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1357 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:06:31.324586 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-98764eb3-a189-4185-a56d-060589a6ac88 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-64764526", "imageRef": "21b89996-9e87-489d-8891-305f6c3d905a", "flavorRef": "452"}} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:06:31.418958 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.network.neutron [None req-98764eb3-a189-4185-a56d-060589a6ac88 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] validate_networks() for None {{(pid=118184) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 21:06:31.603393 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-20561f3f-8d94-4c51-a6d9-646384747ef8 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:31.604765 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-20561f3f-8d94-4c51-a6d9-646384747ef8 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:31.621225 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-20561f3f-8d94-4c51-a6d9-646384747ef8 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:31.621225 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-20561f3f-8d94-4c51-a6d9-646384747ef8 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:31.621225 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-20561f3f-8d94-4c51-a6d9-646384747ef8 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:31.621225 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-20561f3f-8d94-4c51-a6d9-646384747ef8 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:31.814972 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.virt.hardware [None req-98764eb3-a189-4185-a56d-060589a6ac88 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Flavor limits 0:0:0 {{(pid=118184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 21:06:31.815626 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.virt.hardware [None req-98764eb3-a189-4185-a56d-060589a6ac88 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Image limits 0:0:0 {{(pid=118184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 21:06:31.816304 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.virt.hardware [None req-98764eb3-a189-4185-a56d-060589a6ac88 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Flavor pref 0:0:0 {{(pid=118184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 21:06:31.816937 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.virt.hardware [None req-98764eb3-a189-4185-a56d-060589a6ac88 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Image pref 0:0:0 {{(pid=118184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 21:06:31.817541 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.virt.hardware [None req-98764eb3-a189-4185-a56d-060589a6ac88 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 21:06:31.830667 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-98764eb3-a189-4185-a56d-060589a6ac88 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:31.831401 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-98764eb3-a189-4185-a56d-060589a6ac88 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:31.832733 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-98764eb3-a189-4185-a56d-060589a6ac88 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:31.833406 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-98764eb3-a189-4185-a56d-060589a6ac88 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:31.844480 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell1:SELECT=100 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:31.857068 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.quota [None req-98764eb3-a189-4185-a56d-060589a6ac88 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Getting quotas for project c6200f6e9a2e4582b7998f59c2432557. Resources: {'ram', 'cores', 'instances'} {{(pid=118184) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 21:06:31.871310 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.quota [None req-98764eb3-a189-4185-a56d-060589a6ac88 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Getting quotas for user 09a42f9bd4f04176bd23a3324f6b4e8e and project c6200f6e9a2e4582b7998f59c2432557. Resources: {'ram', 'cores', 'instances'} {{(pid=118184) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 21:06:31.888144 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-98764eb3-a189-4185-a56d-060589a6ac88 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Going to run 1 instances... {{(pid=118184) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 21:06:31.893945 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-98764eb3-a189-4185-a56d-060589a6ac88 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] [instance: 05eb6210-0234-435d-bf80-4e701ec1cc0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='21b89996-9e87-489d-8891-305f6c3d905a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118184) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 21:06:31.904714 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-20561f3f-8d94-4c51-a6d9-646384747ef8 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:31.921585 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-20561f3f-8d94-4c51-a6d9-646384747ef8 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1370 microversion: 2.1 time: 0.326221 May 31 21:06:31.922250 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 175/376] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:31 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1370 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:06:31.930247 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-5f05845a-7f9c-48da-9d16-fa49a927b459 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:31.937394 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-5f05845a-7f9c-48da-9d16-fa49a927b459 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:31.945951 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-5f05845a-7f9c-48da-9d16-fa49a927b459 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:31.946118 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-5f05845a-7f9c-48da-9d16-fa49a927b459 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:31.947502 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-5f05845a-7f9c-48da-9d16-fa49a927b459 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:31.948289 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-5f05845a-7f9c-48da-9d16-fa49a927b459 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:32.156756 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-5f05845a-7f9c-48da-9d16-fa49a927b459 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:32.179989 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-98764eb3-a189-4185-a56d-060589a6ac88 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.859640 May 31 21:06:32.181440 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 202/377] 10.222.0.55 () {60 vars in 1146 bytes} [Tue May 31 21:06:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 862 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 31 21:06:32.202731 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-91314a75-8d0b-4a44-a541-22f697a8e1ec tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:32.205682 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-91314a75-8d0b-4a44-a541-22f697a8e1ec tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] [instance: 05eb6210-0234-435d-bf80-4e701ec1cc0c] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:32.210775 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-5f05845a-7f9c-48da-9d16-fa49a927b459 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1547 microversion: 2.1 time: 0.284571 May 31 21:06:32.211977 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 176/378] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:31 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1547 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:06:32.236017 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-e873dcb2-d87b-422d-b183-78355034aa28 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:32.236017 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-e873dcb2-d87b-422d-b183-78355034aa28 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:32.240232 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e873dcb2-d87b-422d-b183-78355034aa28 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:32.241682 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e873dcb2-d87b-422d-b183-78355034aa28 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:32.242808 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e873dcb2-d87b-422d-b183-78355034aa28 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:32.243478 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e873dcb2-d87b-422d-b183-78355034aa28 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:32.360521 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-91314a75-8d0b-4a44-a541-22f697a8e1ec tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09a42f9bd4f04176bd23a3324f6b4e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6200f6e9a2e4582b7998f59c2432557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:32.374987 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-91314a75-8d0b-4a44-a541-22f697a8e1ec tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] 10.222.0.55 "GET /compute/v2.1/servers/05eb6210-0234-435d-bf80-4e701ec1cc0c" status: 200 len: 1213 microversion: 2.1 time: 0.181953 May 31 21:06:32.374987 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 203/379] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:32 2022] GET /compute/v2.1/servers/05eb6210-0234-435d-bf80-4e701ec1cc0c => generated 1213 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:06:32.385673 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [req-97183806-a2e0-4bb2-8b65-995f5f04a493 req-ea2934f6-aed8-4046-b3cb-f85c62f396e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff87c7f6-31a7-4836-be01-c23f9c73629f", "name": "network-vif-plugged", "status": "completed", "tag": "f7d9ea30-c776-41ba-8cc7-b1d9dce9aa77"}]} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:06:32.406199 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-97183806-a2e0-4bb2-8b65-995f5f04a493 req-ea2934f6-aed8-4046-b3cb-f85c62f396e6 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:32.410519 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-97183806-a2e0-4bb2-8b65-995f5f04a493 req-ea2934f6-aed8-4046-b3cb-f85c62f396e6 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:32.460371 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.compute.server_external_events [req-97183806-a2e0-4bb2-8b65-995f5f04a493 req-ea2934f6-aed8-4046-b3cb-f85c62f396e6 service nova] Creating event network-vif-plugged:f7d9ea30-c776-41ba-8cc7-b1d9dce9aa77 for instance ff87c7f6-31a7-4836-be01-c23f9c73629f on hv-cinder-83979 May 31 21:06:32.477965 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [req-97183806-a2e0-4bb2-8b65-995f5f04a493 req-ea2934f6-aed8-4046-b3cb-f85c62f396e6 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102622 May 31 21:06:32.478824 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 204/380] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:06:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:06:32.502439 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-e873dcb2-d87b-422d-b183-78355034aa28 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:32.513411 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-e873dcb2-d87b-422d-b183-78355034aa28 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1547 microversion: 2.1 time: 0.288496 May 31 21:06:32.519202 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 177/381] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:32 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1547 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:06:32.538307 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-6152c0d3-6bf9-45c6-b467-706438e0c16b tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:32.553089 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-6152c0d3-6bf9-45c6-b467-706438e0c16b tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:32.553996 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-6152c0d3-6bf9-45c6-b467-706438e0c16b tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Searching by: {'deleted': False, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf'} {{(pid=118184) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 31 21:06:32.578023 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6152c0d3-6bf9-45c6-b467-706438e0c16b tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:32.578798 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6152c0d3-6bf9-45c6-b467-706438e0c16b tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:32.579866 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6152c0d3-6bf9-45c6-b467-706438e0c16b tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:32.580493 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6152c0d3-6bf9-45c6-b467-706438e0c16b tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:32.712857 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.multi_cell_list [None req-6152c0d3-6bf9-45c6-b467-706438e0c16b tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118184) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 31 21:06:32.833003 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-6152c0d3-6bf9-45c6-b467-706438e0c16b tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.306329 May 31 21:06:32.833913 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 205/382] 10.222.0.55 () {58 vars in 1124 bytes} [Tue May 31 21:06:32 2022] GET /compute/v2.1/servers => generated 342 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 21:06:32.855988 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-9b5a744b-224e-4d12-bee8-2a50e7661a77 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:32.855988 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-9b5a744b-224e-4d12-bee8-2a50e7661a77 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:32.884005 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9b5a744b-224e-4d12-bee8-2a50e7661a77 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:32.886971 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9b5a744b-224e-4d12-bee8-2a50e7661a77 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:32.888229 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9b5a744b-224e-4d12-bee8-2a50e7661a77 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:32.888718 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9b5a744b-224e-4d12-bee8-2a50e7661a77 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:32.942664 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-6f928397-5fc6-4da5-8963-ad172969b938 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:32.946151 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-6f928397-5fc6-4da5-8963-ad172969b938 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:32.960025 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6f928397-5fc6-4da5-8963-ad172969b938 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:32.960508 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6f928397-5fc6-4da5-8963-ad172969b938 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:32.961844 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6f928397-5fc6-4da5-8963-ad172969b938 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:32.962404 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6f928397-5fc6-4da5-8963-ad172969b938 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:33.124729 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-9b5a744b-224e-4d12-bee8-2a50e7661a77 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:33.143478 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-9b5a744b-224e-4d12-bee8-2a50e7661a77 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1547 microversion: 2.1 time: 0.298803 May 31 21:06:33.144241 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 178/383] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:32 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1547 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:06:33.179615 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-6f928397-5fc6-4da5-8963-ad172969b938 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:33.188876 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-6f928397-5fc6-4da5-8963-ad172969b938 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1370 microversion: 2.1 time: 0.252321 May 31 21:06:33.189486 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 206/384] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:32 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1370 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:06:33.403600 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-6c136363-c08c-45c9-863b-1c1998e853c1 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:33.404215 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-6c136363-c08c-45c9-863b-1c1998e853c1 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] [instance: 05eb6210-0234-435d-bf80-4e701ec1cc0c] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:33.474301 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-6c136363-c08c-45c9-863b-1c1998e853c1 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09a42f9bd4f04176bd23a3324f6b4e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6200f6e9a2e4582b7998f59c2432557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:33.481576 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-6c136363-c08c-45c9-863b-1c1998e853c1 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] 10.222.0.55 "GET /compute/v2.1/servers/05eb6210-0234-435d-bf80-4e701ec1cc0c" status: 200 len: 1213 microversion: 2.1 time: 0.081954 May 31 21:06:33.482196 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 179/385] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:33 2022] GET /compute/v2.1/servers/05eb6210-0234-435d-bf80-4e701ec1cc0c => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:06:34.207732 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-9d14b322-a46a-495c-b479-e7d14efad015 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:34.209131 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-9d14b322-a46a-495c-b479-e7d14efad015 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:34.215538 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-9d14b322-a46a-495c-b479-e7d14efad015 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:34.215987 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-9d14b322-a46a-495c-b479-e7d14efad015 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:34.216760 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-9d14b322-a46a-495c-b479-e7d14efad015 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:34.217196 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-9d14b322-a46a-495c-b479-e7d14efad015 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:34.392992 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-9d14b322-a46a-495c-b479-e7d14efad015 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:34.400497 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-9d14b322-a46a-495c-b479-e7d14efad015 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1370 microversion: 2.1 time: 0.197059 May 31 21:06:34.401071 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 207/386] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:34 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1370 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:06:34.500121 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-255a503c-d195-4cfc-a3d2-4d30b57b57d2 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:34.500637 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-255a503c-d195-4cfc-a3d2-4d30b57b57d2 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] [instance: 05eb6210-0234-435d-bf80-4e701ec1cc0c] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:34.507456 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-255a503c-d195-4cfc-a3d2-4d30b57b57d2 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:34.507893 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-255a503c-d195-4cfc-a3d2-4d30b57b57d2 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:34.508912 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-255a503c-d195-4cfc-a3d2-4d30b57b57d2 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:34.509395 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-255a503c-d195-4cfc-a3d2-4d30b57b57d2 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:34.586821 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-255a503c-d195-4cfc-a3d2-4d30b57b57d2 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09a42f9bd4f04176bd23a3324f6b4e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6200f6e9a2e4582b7998f59c2432557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:34.596222 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-255a503c-d195-4cfc-a3d2-4d30b57b57d2 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] 10.222.0.55 "GET /compute/v2.1/servers/05eb6210-0234-435d-bf80-4e701ec1cc0c" status: 200 len: 1209 microversion: 2.1 time: 0.100047 May 31 21:06:34.598077 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 180/387] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:34 2022] GET /compute/v2.1/servers/05eb6210-0234-435d-bf80-4e701ec1cc0c => generated 1209 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:06:35.419844 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-6b07dfcf-1e62-4942-b327-44c972dc9901 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:35.420614 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-6b07dfcf-1e62-4942-b327-44c972dc9901 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:35.427638 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6b07dfcf-1e62-4942-b327-44c972dc9901 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:35.428154 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6b07dfcf-1e62-4942-b327-44c972dc9901 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:35.429206 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6b07dfcf-1e62-4942-b327-44c972dc9901 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:35.429979 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6b07dfcf-1e62-4942-b327-44c972dc9901 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:35.575616 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-6b07dfcf-1e62-4942-b327-44c972dc9901 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:35.585751 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-6b07dfcf-1e62-4942-b327-44c972dc9901 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1370 microversion: 2.1 time: 0.170392 May 31 21:06:35.586574 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 208/388] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:35 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1370 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:06:35.617193 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-b6f0ccc8-8f5f-4dfa-aaa4-b822e6c05c34 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:35.617817 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-b6f0ccc8-8f5f-4dfa-aaa4-b822e6c05c34 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] [instance: 05eb6210-0234-435d-bf80-4e701ec1cc0c] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:35.624955 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b6f0ccc8-8f5f-4dfa-aaa4-b822e6c05c34 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:35.625415 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b6f0ccc8-8f5f-4dfa-aaa4-b822e6c05c34 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:35.626246 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b6f0ccc8-8f5f-4dfa-aaa4-b822e6c05c34 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:35.626690 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b6f0ccc8-8f5f-4dfa-aaa4-b822e6c05c34 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:35.694716 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-b6f0ccc8-8f5f-4dfa-aaa4-b822e6c05c34 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09a42f9bd4f04176bd23a3324f6b4e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6200f6e9a2e4582b7998f59c2432557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:35.703316 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-b6f0ccc8-8f5f-4dfa-aaa4-b822e6c05c34 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] 10.222.0.55 "GET /compute/v2.1/servers/05eb6210-0234-435d-bf80-4e701ec1cc0c" status: 200 len: 1209 microversion: 2.1 time: 0.091728 May 31 21:06:35.703915 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 181/389] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:35 2022] GET /compute/v2.1/servers/05eb6210-0234-435d-bf80-4e701ec1cc0c => generated 1209 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:06:36.605018 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-7924d202-1e2d-4fca-a671-e4956d1f1874 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:36.605614 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-7924d202-1e2d-4fca-a671-e4956d1f1874 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:36.612161 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7924d202-1e2d-4fca-a671-e4956d1f1874 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:36.612611 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7924d202-1e2d-4fca-a671-e4956d1f1874 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:36.613408 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7924d202-1e2d-4fca-a671-e4956d1f1874 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:36.613852 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7924d202-1e2d-4fca-a671-e4956d1f1874 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:36.721769 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-a22e8406-cd19-440e-a724-50e1a2a1d768 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:36.722547 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-a22e8406-cd19-440e-a724-50e1a2a1d768 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] [instance: 05eb6210-0234-435d-bf80-4e701ec1cc0c] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:36.731299 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a22e8406-cd19-440e-a724-50e1a2a1d768 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:36.731882 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a22e8406-cd19-440e-a724-50e1a2a1d768 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:36.732789 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a22e8406-cd19-440e-a724-50e1a2a1d768 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:36.733390 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a22e8406-cd19-440e-a724-50e1a2a1d768 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:36.824992 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-a22e8406-cd19-440e-a724-50e1a2a1d768 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09a42f9bd4f04176bd23a3324f6b4e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6200f6e9a2e4582b7998f59c2432557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:36.837663 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-a22e8406-cd19-440e-a724-50e1a2a1d768 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] 10.222.0.55 "GET /compute/v2.1/servers/05eb6210-0234-435d-bf80-4e701ec1cc0c" status: 200 len: 1209 microversion: 2.1 time: 0.119611 May 31 21:06:36.838595 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 182/390] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:36 2022] GET /compute/v2.1/servers/05eb6210-0234-435d-bf80-4e701ec1cc0c => generated 1209 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:06:36.851814 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-7924d202-1e2d-4fca-a671-e4956d1f1874 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:36.860593 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-7924d202-1e2d-4fca-a671-e4956d1f1874 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1370 microversion: 2.1 time: 0.259505 May 31 21:06:36.861201 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 209/391] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:36 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1370 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:06:37.858633 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-cdf8813c-29dd-410c-9464-08a4a8b3920f tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:37.859330 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-cdf8813c-29dd-410c-9464-08a4a8b3920f tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] [instance: 05eb6210-0234-435d-bf80-4e701ec1cc0c] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:37.866400 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-cdf8813c-29dd-410c-9464-08a4a8b3920f tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:37.866849 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-cdf8813c-29dd-410c-9464-08a4a8b3920f tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:37.867630 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-cdf8813c-29dd-410c-9464-08a4a8b3920f tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:37.868067 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-cdf8813c-29dd-410c-9464-08a4a8b3920f tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:37.880605 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-74e84613-9e82-478a-9376-ef34a3452f76 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:37.881235 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-74e84613-9e82-478a-9376-ef34a3452f76 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:37.888388 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-74e84613-9e82-478a-9376-ef34a3452f76 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:37.888837 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-74e84613-9e82-478a-9376-ef34a3452f76 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:37.889627 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-74e84613-9e82-478a-9376-ef34a3452f76 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:37.890094 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-74e84613-9e82-478a-9376-ef34a3452f76 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:37.945105 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-cdf8813c-29dd-410c-9464-08a4a8b3920f tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09a42f9bd4f04176bd23a3324f6b4e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6200f6e9a2e4582b7998f59c2432557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:37.953718 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-cdf8813c-29dd-410c-9464-08a4a8b3920f tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] 10.222.0.55 "GET /compute/v2.1/servers/05eb6210-0234-435d-bf80-4e701ec1cc0c" status: 200 len: 1209 microversion: 2.1 time: 0.098870 May 31 21:06:37.954350 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 183/392] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:37 2022] GET /compute/v2.1/servers/05eb6210-0234-435d-bf80-4e701ec1cc0c => generated 1209 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:06:38.040014 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-74e84613-9e82-478a-9376-ef34a3452f76 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:38.053021 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-74e84613-9e82-478a-9376-ef34a3452f76 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1370 microversion: 2.1 time: 0.179286 May 31 21:06:38.053770 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 210/393] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:37 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1370 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:06:38.972376 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-56f64bc8-ab4e-44e7-8d82-be602a5245fb tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:38.973173 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-56f64bc8-ab4e-44e7-8d82-be602a5245fb tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] [instance: 05eb6210-0234-435d-bf80-4e701ec1cc0c] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:38.980586 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-56f64bc8-ab4e-44e7-8d82-be602a5245fb tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:38.981054 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-56f64bc8-ab4e-44e7-8d82-be602a5245fb tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:38.981819 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-56f64bc8-ab4e-44e7-8d82-be602a5245fb tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:38.982287 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-56f64bc8-ab4e-44e7-8d82-be602a5245fb tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:39.048930 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-56f64bc8-ab4e-44e7-8d82-be602a5245fb tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09a42f9bd4f04176bd23a3324f6b4e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6200f6e9a2e4582b7998f59c2432557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:39.062367 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-56f64bc8-ab4e-44e7-8d82-be602a5245fb tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] 10.222.0.55 "GET /compute/v2.1/servers/05eb6210-0234-435d-bf80-4e701ec1cc0c" status: 200 len: 1209 microversion: 2.1 time: 0.093436 May 31 21:06:39.063398 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 184/394] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:38 2022] GET /compute/v2.1/servers/05eb6210-0234-435d-bf80-4e701ec1cc0c => generated 1209 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:06:39.080449 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-206ee89d-e1a5-4af2-b787-73d3a6402554 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:39.081558 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-206ee89d-e1a5-4af2-b787-73d3a6402554 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:39.092521 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-206ee89d-e1a5-4af2-b787-73d3a6402554 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:39.093300 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-206ee89d-e1a5-4af2-b787-73d3a6402554 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:39.094716 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-206ee89d-e1a5-4af2-b787-73d3a6402554 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:39.095478 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-206ee89d-e1a5-4af2-b787-73d3a6402554 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:39.299244 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-206ee89d-e1a5-4af2-b787-73d3a6402554 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:39.307190 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-206ee89d-e1a5-4af2-b787-73d3a6402554 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1370 microversion: 2.1 time: 0.234370 May 31 21:06:39.307778 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 211/395] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:39 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1370 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:06:40.081301 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-bd11addf-71cf-4d80-998b-54b93590c8ff tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:40.081917 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-bd11addf-71cf-4d80-998b-54b93590c8ff tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] [instance: 05eb6210-0234-435d-bf80-4e701ec1cc0c] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:40.089223 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-bd11addf-71cf-4d80-998b-54b93590c8ff tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:40.090614 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-bd11addf-71cf-4d80-998b-54b93590c8ff tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:40.091518 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-bd11addf-71cf-4d80-998b-54b93590c8ff tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:40.092037 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-bd11addf-71cf-4d80-998b-54b93590c8ff tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:40.164184 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-bd11addf-71cf-4d80-998b-54b93590c8ff tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09a42f9bd4f04176bd23a3324f6b4e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6200f6e9a2e4582b7998f59c2432557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:40.172571 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-bd11addf-71cf-4d80-998b-54b93590c8ff tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] 10.222.0.55 "GET /compute/v2.1/servers/05eb6210-0234-435d-bf80-4e701ec1cc0c" status: 200 len: 1209 microversion: 2.1 time: 0.095247 May 31 21:06:40.173161 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 185/396] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:40 2022] GET /compute/v2.1/servers/05eb6210-0234-435d-bf80-4e701ec1cc0c => generated 1209 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:06:40.324716 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-623a191d-d202-401b-a1a7-b972a412a1b0 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:40.325363 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-623a191d-d202-401b-a1a7-b972a412a1b0 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:40.331821 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-623a191d-d202-401b-a1a7-b972a412a1b0 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:40.332305 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-623a191d-d202-401b-a1a7-b972a412a1b0 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:40.333360 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-623a191d-d202-401b-a1a7-b972a412a1b0 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:40.333798 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-623a191d-d202-401b-a1a7-b972a412a1b0 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:40.481139 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-623a191d-d202-401b-a1a7-b972a412a1b0 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:40.488918 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-623a191d-d202-401b-a1a7-b972a412a1b0 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1370 microversion: 2.1 time: 0.168140 May 31 21:06:40.489503 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 212/397] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:40 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1370 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:06:41.190480 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-4024678f-9f32-45d7-be25-f7cd9486b2b3 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:41.191226 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-4024678f-9f32-45d7-be25-f7cd9486b2b3 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] [instance: 05eb6210-0234-435d-bf80-4e701ec1cc0c] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:41.198612 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4024678f-9f32-45d7-be25-f7cd9486b2b3 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:41.199672 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4024678f-9f32-45d7-be25-f7cd9486b2b3 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:41.200738 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4024678f-9f32-45d7-be25-f7cd9486b2b3 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:41.201189 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4024678f-9f32-45d7-be25-f7cd9486b2b3 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:41.279047 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-4024678f-9f32-45d7-be25-f7cd9486b2b3 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09a42f9bd4f04176bd23a3324f6b4e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6200f6e9a2e4582b7998f59c2432557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:41.288469 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-4024678f-9f32-45d7-be25-f7cd9486b2b3 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] 10.222.0.55 "GET /compute/v2.1/servers/05eb6210-0234-435d-bf80-4e701ec1cc0c" status: 200 len: 1265 microversion: 2.1 time: 0.101234 May 31 21:06:41.288469 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 186/398] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:41 2022] GET /compute/v2.1/servers/05eb6210-0234-435d-bf80-4e701ec1cc0c => generated 1265 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:06:41.509072 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-e0cc4168-b64a-4f73-ae52-644921bb89de tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:41.509621 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-e0cc4168-b64a-4f73-ae52-644921bb89de tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:41.516608 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e0cc4168-b64a-4f73-ae52-644921bb89de tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:41.517029 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e0cc4168-b64a-4f73-ae52-644921bb89de tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:41.517808 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e0cc4168-b64a-4f73-ae52-644921bb89de tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:41.518460 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e0cc4168-b64a-4f73-ae52-644921bb89de tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:41.706310 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-e0cc4168-b64a-4f73-ae52-644921bb89de tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:41.717014 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-e0cc4168-b64a-4f73-ae52-644921bb89de tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1565 microversion: 2.1 time: 0.211493 May 31 21:06:41.719497 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 213/399] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:41 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1565 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:06:41.737307 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-9a40627f-0531-4517-9899-72ae0e46df5e tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:41.737790 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-9a40627f-0531-4517-9899-72ae0e46df5e tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:41.747061 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9a40627f-0531-4517-9899-72ae0e46df5e tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:41.747514 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9a40627f-0531-4517-9899-72ae0e46df5e tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:41.748314 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9a40627f-0531-4517-9899-72ae0e46df5e tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:41.749983 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9a40627f-0531-4517-9899-72ae0e46df5e tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:41.877946 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-9a40627f-0531-4517-9899-72ae0e46df5e tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.144415 May 31 21:06:41.878545 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 187/400] 10.222.0.55 () {58 vars in 1274 bytes} [Tue May 31 21:06:41 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f/os-interface => generated 285 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:06:41.908940 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 21:06:41.909194 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Tue May 31 21:06:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 21:06:42.278418 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-7af92520-a8ef-458a-b24e-dcb8f8b6e027 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b93bf48a-335c-4340-8610-1bcaaaa7c123"}} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:06:42.278418 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-7af92520-a8ef-458a-b24e-dcb8f8b6e027 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:42.278418 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7af92520-a8ef-458a-b24e-dcb8f8b6e027 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:42.278418 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7af92520-a8ef-458a-b24e-dcb8f8b6e027 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:42.279583 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7af92520-a8ef-458a-b24e-dcb8f8b6e027 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:42.279583 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7af92520-a8ef-458a-b24e-dcb8f8b6e027 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:42.305614 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-358fa835-3a0f-4007-8ee1-413a6a119f8f tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:42.306278 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-358fa835-3a0f-4007-8ee1-413a6a119f8f tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] [instance: 05eb6210-0234-435d-bf80-4e701ec1cc0c] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:42.314491 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-358fa835-3a0f-4007-8ee1-413a6a119f8f tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:42.315382 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-358fa835-3a0f-4007-8ee1-413a6a119f8f tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:42.324263 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-358fa835-3a0f-4007-8ee1-413a6a119f8f tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:42.324263 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-358fa835-3a0f-4007-8ee1-413a6a119f8f tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:42.372274 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell0:SELECT=8 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:42.528466 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-358fa835-3a0f-4007-8ee1-413a6a119f8f tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09a42f9bd4f04176bd23a3324f6b4e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6200f6e9a2e4582b7998f59c2432557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:42.537085 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-358fa835-3a0f-4007-8ee1-413a6a119f8f tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] 10.222.0.55 "GET /compute/v2.1/servers/05eb6210-0234-435d-bf80-4e701ec1cc0c" status: 200 len: 1283 microversion: 2.1 time: 0.236278 May 31 21:06:42.548364 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 188/401] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:42 2022] GET /compute/v2.1/servers/05eb6210-0234-435d-bf80-4e701ec1cc0c => generated 1283 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:06:42.623380 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell0:SELECT=4 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:43.447781 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-7af92520-a8ef-458a-b24e-dcb8f8b6e027 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "POST /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.339551 May 31 21:06:43.458379 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 214/402] 10.222.0.55 () {60 vars in 1322 bytes} [Tue May 31 21:06:42 2022] POST /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c/os-volume_attachments => generated 194 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:06:43.512517 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [req-e37200de-4802-4cc1-aa32-222d4e06f80c req-ff81c766-184f-4c83-be46-e43e5f1e0f92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff87c7f6-31a7-4836-be01-c23f9c73629f", "tag": "f7d9ea30-c776-41ba-8cc7-b1d9dce9aa77"}]} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:06:43.522347 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell0:SELECT=2 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:43.536360 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-e37200de-4802-4cc1-aa32-222d4e06f80c req-ff81c766-184f-4c83-be46-e43e5f1e0f92 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:43.536360 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-e37200de-4802-4cc1-aa32-222d4e06f80c req-ff81c766-184f-4c83-be46-e43e5f1e0f92 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:43.572809 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-cfc0aa7e-f7b2-431d-bcdc-1a96583697b6 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:43.575024 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.compute.server_external_events [req-e37200de-4802-4cc1-aa32-222d4e06f80c req-ff81c766-184f-4c83-be46-e43e5f1e0f92 service nova] Creating event network-changed:f7d9ea30-c776-41ba-8cc7-b1d9dce9aa77 for instance ff87c7f6-31a7-4836-be01-c23f9c73629f on hv-cinder-83979 May 31 21:06:43.578689 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-cfc0aa7e-f7b2-431d-bcdc-1a96583697b6 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] [instance: 05eb6210-0234-435d-bf80-4e701ec1cc0c] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:43.584280 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [req-e37200de-4802-4cc1-aa32-222d4e06f80c req-ff81c766-184f-4c83-be46-e43e5f1e0f92 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081726 May 31 21:06:43.585022 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 189/403] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:06:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:06:43.624074 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-cfc0aa7e-f7b2-431d-bcdc-1a96583697b6 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:43.624800 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-cfc0aa7e-f7b2-431d-bcdc-1a96583697b6 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:43.625091 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-cfc0aa7e-f7b2-431d-bcdc-1a96583697b6 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:43.625538 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-cfc0aa7e-f7b2-431d-bcdc-1a96583697b6 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:43.811545 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-cfc0aa7e-f7b2-431d-bcdc-1a96583697b6 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09a42f9bd4f04176bd23a3324f6b4e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6200f6e9a2e4582b7998f59c2432557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:43.822761 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-cfc0aa7e-f7b2-431d-bcdc-1a96583697b6 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] 10.222.0.55 "GET /compute/v2.1/servers/05eb6210-0234-435d-bf80-4e701ec1cc0c" status: 200 len: 1313 microversion: 2.1 time: 0.268986 May 31 21:06:43.836830 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 215/404] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:43 2022] GET /compute/v2.1/servers/05eb6210-0234-435d-bf80-4e701ec1cc0c => generated 1313 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:06:44.845291 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-03db1045-f53d-45bf-8da4-c4947bb6904a tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:44.846125 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-03db1045-f53d-45bf-8da4-c4947bb6904a tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] [instance: 05eb6210-0234-435d-bf80-4e701ec1cc0c] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:44.853311 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-03db1045-f53d-45bf-8da4-c4947bb6904a tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:44.853701 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-03db1045-f53d-45bf-8da4-c4947bb6904a tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:44.854718 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-03db1045-f53d-45bf-8da4-c4947bb6904a tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:44.856020 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-03db1045-f53d-45bf-8da4-c4947bb6904a tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:44.861015 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell1:SELECT=100 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:45.044617 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-03db1045-f53d-45bf-8da4-c4947bb6904a tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09a42f9bd4f04176bd23a3324f6b4e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6200f6e9a2e4582b7998f59c2432557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:45.060640 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-03db1045-f53d-45bf-8da4-c4947bb6904a tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] 10.222.0.55 "GET /compute/v2.1/servers/05eb6210-0234-435d-bf80-4e701ec1cc0c" status: 200 len: 1313 microversion: 2.1 time: 0.221478 May 31 21:06:45.062994 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 190/405] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:44 2022] GET /compute/v2.1/servers/05eb6210-0234-435d-bf80-4e701ec1cc0c => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:06:45.489093 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [req-c2eaafaf-c1aa-46d0-b804-35163a4e8f0b req-d2da7efc-9c31-4d2d-8fc1-d2e1818c18ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05eb6210-0234-435d-bf80-4e701ec1cc0c", "tag": "ae6376d6-cc5c-4a63-8f01-83c120bb79c6"}]} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:06:45.499701 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-c2eaafaf-c1aa-46d0-b804-35163a4e8f0b req-d2da7efc-9c31-4d2d-8fc1-d2e1818c18ce service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:45.504290 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-c2eaafaf-c1aa-46d0-b804-35163a4e8f0b req-d2da7efc-9c31-4d2d-8fc1-d2e1818c18ce service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:45.527848 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.compute.server_external_events [req-c2eaafaf-c1aa-46d0-b804-35163a4e8f0b req-d2da7efc-9c31-4d2d-8fc1-d2e1818c18ce service nova] Creating event network-changed:ae6376d6-cc5c-4a63-8f01-83c120bb79c6 for instance 05eb6210-0234-435d-bf80-4e701ec1cc0c on hv-cinder-83979 May 31 21:06:45.534990 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [req-c2eaafaf-c1aa-46d0-b804-35163a4e8f0b req-d2da7efc-9c31-4d2d-8fc1-d2e1818c18ce service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054538 May 31 21:06:45.535637 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 216/406] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:06:46.081650 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-78599894-987d-41fc-af82-97a1fdc4b1f4 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:46.083153 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-78599894-987d-41fc-af82-97a1fdc4b1f4 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] [instance: 05eb6210-0234-435d-bf80-4e701ec1cc0c] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:46.091822 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-78599894-987d-41fc-af82-97a1fdc4b1f4 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:46.092315 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-78599894-987d-41fc-af82-97a1fdc4b1f4 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:46.093129 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-78599894-987d-41fc-af82-97a1fdc4b1f4 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:46.093571 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-78599894-987d-41fc-af82-97a1fdc4b1f4 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:46.240422 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-78599894-987d-41fc-af82-97a1fdc4b1f4 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09a42f9bd4f04176bd23a3324f6b4e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6200f6e9a2e4582b7998f59c2432557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:46.249663 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-78599894-987d-41fc-af82-97a1fdc4b1f4 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] 10.222.0.55 "GET /compute/v2.1/servers/05eb6210-0234-435d-bf80-4e701ec1cc0c" status: 200 len: 1313 microversion: 2.1 time: 0.172602 May 31 21:06:46.250445 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 191/407] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:46 2022] GET /compute/v2.1/servers/05eb6210-0234-435d-bf80-4e701ec1cc0c => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:06:47.269516 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-9ea1a549-4203-4b1a-b800-5166b757eed8 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:47.270241 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-9ea1a549-4203-4b1a-b800-5166b757eed8 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] [instance: 05eb6210-0234-435d-bf80-4e701ec1cc0c] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:47.273020 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:47.280466 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-9ea1a549-4203-4b1a-b800-5166b757eed8 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:47.281048 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-9ea1a549-4203-4b1a-b800-5166b757eed8 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:47.286622 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-9ea1a549-4203-4b1a-b800-5166b757eed8 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:47.286622 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-9ea1a549-4203-4b1a-b800-5166b757eed8 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:47.425079 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-9ea1a549-4203-4b1a-b800-5166b757eed8 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09a42f9bd4f04176bd23a3324f6b4e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6200f6e9a2e4582b7998f59c2432557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:47.432726 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-9ea1a549-4203-4b1a-b800-5166b757eed8 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] 10.222.0.55 "GET /compute/v2.1/servers/05eb6210-0234-435d-bf80-4e701ec1cc0c" status: 200 len: 1313 microversion: 2.1 time: 0.168007 May 31 21:06:47.433951 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 217/408] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:47 2022] GET /compute/v2.1/servers/05eb6210-0234-435d-bf80-4e701ec1cc0c => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:06:48.450723 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-b553bfc8-6139-4f55-a389-06c5117d76fa tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:48.451333 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-b553bfc8-6139-4f55-a389-06c5117d76fa tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] [instance: 05eb6210-0234-435d-bf80-4e701ec1cc0c] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:48.458128 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b553bfc8-6139-4f55-a389-06c5117d76fa tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:48.458575 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b553bfc8-6139-4f55-a389-06c5117d76fa tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:48.459331 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b553bfc8-6139-4f55-a389-06c5117d76fa tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:48.459759 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b553bfc8-6139-4f55-a389-06c5117d76fa tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:48.602113 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-b553bfc8-6139-4f55-a389-06c5117d76fa tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09a42f9bd4f04176bd23a3324f6b4e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6200f6e9a2e4582b7998f59c2432557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:48.610132 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-b553bfc8-6139-4f55-a389-06c5117d76fa tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] 10.222.0.55 "GET /compute/v2.1/servers/05eb6210-0234-435d-bf80-4e701ec1cc0c" status: 200 len: 1313 microversion: 2.1 time: 0.163219 May 31 21:06:48.611980 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 192/409] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:48 2022] GET /compute/v2.1/servers/05eb6210-0234-435d-bf80-4e701ec1cc0c => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:06:49.628800 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-fb8a75ac-8c04-46ef-b8af-921d0a0d8798 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:49.629501 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-fb8a75ac-8c04-46ef-b8af-921d0a0d8798 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] [instance: 05eb6210-0234-435d-bf80-4e701ec1cc0c] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:49.636065 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-fb8a75ac-8c04-46ef-b8af-921d0a0d8798 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:49.636514 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-fb8a75ac-8c04-46ef-b8af-921d0a0d8798 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:49.637285 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-fb8a75ac-8c04-46ef-b8af-921d0a0d8798 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:49.637718 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-fb8a75ac-8c04-46ef-b8af-921d0a0d8798 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:49.774328 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-fb8a75ac-8c04-46ef-b8af-921d0a0d8798 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09a42f9bd4f04176bd23a3324f6b4e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6200f6e9a2e4582b7998f59c2432557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:49.782227 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-fb8a75ac-8c04-46ef-b8af-921d0a0d8798 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] 10.222.0.55 "GET /compute/v2.1/servers/05eb6210-0234-435d-bf80-4e701ec1cc0c" status: 200 len: 1313 microversion: 2.1 time: 0.157250 May 31 21:06:49.782846 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 218/410] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:49 2022] GET /compute/v2.1/servers/05eb6210-0234-435d-bf80-4e701ec1cc0c => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:06:50.806918 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-5fa1c4a6-ec14-4aef-ba2e-fc724ad87c27 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:50.807996 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-5fa1c4a6-ec14-4aef-ba2e-fc724ad87c27 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] [instance: 05eb6210-0234-435d-bf80-4e701ec1cc0c] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:50.815291 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-5fa1c4a6-ec14-4aef-ba2e-fc724ad87c27 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:50.815769 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-5fa1c4a6-ec14-4aef-ba2e-fc724ad87c27 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:50.816508 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-5fa1c4a6-ec14-4aef-ba2e-fc724ad87c27 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:50.816940 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-5fa1c4a6-ec14-4aef-ba2e-fc724ad87c27 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:50.966261 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-5fa1c4a6-ec14-4aef-ba2e-fc724ad87c27 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09a42f9bd4f04176bd23a3324f6b4e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6200f6e9a2e4582b7998f59c2432557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:50.974680 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-5fa1c4a6-ec14-4aef-ba2e-fc724ad87c27 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] 10.222.0.55 "GET /compute/v2.1/servers/05eb6210-0234-435d-bf80-4e701ec1cc0c" status: 200 len: 1313 microversion: 2.1 time: 0.178056 May 31 21:06:50.975293 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 193/411] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:50 2022] GET /compute/v2.1/servers/05eb6210-0234-435d-bf80-4e701ec1cc0c => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:06:51.992001 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-b29a11ca-78d6-4422-97c5-cde099d3584c tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:51.992681 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-b29a11ca-78d6-4422-97c5-cde099d3584c tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] [instance: 05eb6210-0234-435d-bf80-4e701ec1cc0c] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:52.000462 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b29a11ca-78d6-4422-97c5-cde099d3584c tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:52.007568 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b29a11ca-78d6-4422-97c5-cde099d3584c tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:52.007568 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b29a11ca-78d6-4422-97c5-cde099d3584c tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:52.007568 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b29a11ca-78d6-4422-97c5-cde099d3584c tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:52.147972 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-b29a11ca-78d6-4422-97c5-cde099d3584c tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09a42f9bd4f04176bd23a3324f6b4e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6200f6e9a2e4582b7998f59c2432557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:52.156335 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-b29a11ca-78d6-4422-97c5-cde099d3584c tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] 10.222.0.55 "GET /compute/v2.1/servers/05eb6210-0234-435d-bf80-4e701ec1cc0c" status: 200 len: 1313 microversion: 2.1 time: 0.168190 May 31 21:06:52.156926 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 219/412] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:51 2022] GET /compute/v2.1/servers/05eb6210-0234-435d-bf80-4e701ec1cc0c => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:06:53.176244 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-e554155b-dedd-4021-a159-baea2c88ddde tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:53.176244 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-e554155b-dedd-4021-a159-baea2c88ddde tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] [instance: 05eb6210-0234-435d-bf80-4e701ec1cc0c] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:53.185122 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e554155b-dedd-4021-a159-baea2c88ddde tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:53.185642 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e554155b-dedd-4021-a159-baea2c88ddde tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:53.186377 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e554155b-dedd-4021-a159-baea2c88ddde tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:53.186926 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e554155b-dedd-4021-a159-baea2c88ddde tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:53.387288 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-e554155b-dedd-4021-a159-baea2c88ddde tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09a42f9bd4f04176bd23a3324f6b4e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6200f6e9a2e4582b7998f59c2432557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:53.395969 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-e554155b-dedd-4021-a159-baea2c88ddde tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] 10.222.0.55 "GET /compute/v2.1/servers/05eb6210-0234-435d-bf80-4e701ec1cc0c" status: 200 len: 1313 microversion: 2.1 time: 0.224742 May 31 21:06:53.396788 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 194/413] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:53 2022] GET /compute/v2.1/servers/05eb6210-0234-435d-bf80-4e701ec1cc0c => generated 1313 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:06:54.417145 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-8da52315-df1a-4051-a28d-66c10bf0bb9c tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:54.417806 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-8da52315-df1a-4051-a28d-66c10bf0bb9c tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] [instance: 05eb6210-0234-435d-bf80-4e701ec1cc0c] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:54.430249 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-8da52315-df1a-4051-a28d-66c10bf0bb9c tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:54.430249 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-8da52315-df1a-4051-a28d-66c10bf0bb9c tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:54.430249 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-8da52315-df1a-4051-a28d-66c10bf0bb9c tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:54.430249 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-8da52315-df1a-4051-a28d-66c10bf0bb9c tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:54.441488 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:54.598238 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-8da52315-df1a-4051-a28d-66c10bf0bb9c tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09a42f9bd4f04176bd23a3324f6b4e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6200f6e9a2e4582b7998f59c2432557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:54.608475 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-8da52315-df1a-4051-a28d-66c10bf0bb9c tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] 10.222.0.55 "GET /compute/v2.1/servers/05eb6210-0234-435d-bf80-4e701ec1cc0c" status: 200 len: 1313 microversion: 2.1 time: 0.195207 May 31 21:06:54.609849 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 220/414] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:54 2022] GET /compute/v2.1/servers/05eb6210-0234-435d-bf80-4e701ec1cc0c => generated 1313 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:06:55.625383 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-575d88e5-9464-4031-a8dc-87c9e1673c52 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:55.626157 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-575d88e5-9464-4031-a8dc-87c9e1673c52 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] [instance: 05eb6210-0234-435d-bf80-4e701ec1cc0c] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:55.633395 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-575d88e5-9464-4031-a8dc-87c9e1673c52 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:55.633840 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-575d88e5-9464-4031-a8dc-87c9e1673c52 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:55.634827 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-575d88e5-9464-4031-a8dc-87c9e1673c52 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:55.635177 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-575d88e5-9464-4031-a8dc-87c9e1673c52 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:55.835699 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-575d88e5-9464-4031-a8dc-87c9e1673c52 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09a42f9bd4f04176bd23a3324f6b4e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6200f6e9a2e4582b7998f59c2432557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:55.848448 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-575d88e5-9464-4031-a8dc-87c9e1673c52 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] 10.222.0.55 "GET /compute/v2.1/servers/05eb6210-0234-435d-bf80-4e701ec1cc0c" status: 200 len: 1313 microversion: 2.1 time: 0.227694 May 31 21:06:55.849235 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 195/415] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:55 2022] GET /compute/v2.1/servers/05eb6210-0234-435d-bf80-4e701ec1cc0c => generated 1313 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:06:56.868903 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-f75cd862-9eea-4d97-9cb2-8fcdaed762b9 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:56.871494 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-f75cd862-9eea-4d97-9cb2-8fcdaed762b9 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] [instance: 05eb6210-0234-435d-bf80-4e701ec1cc0c] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:56.882742 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f75cd862-9eea-4d97-9cb2-8fcdaed762b9 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:56.883550 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f75cd862-9eea-4d97-9cb2-8fcdaed762b9 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:56.885053 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f75cd862-9eea-4d97-9cb2-8fcdaed762b9 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:56.885873 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f75cd862-9eea-4d97-9cb2-8fcdaed762b9 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:57.109187 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-f75cd862-9eea-4d97-9cb2-8fcdaed762b9 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09a42f9bd4f04176bd23a3324f6b4e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6200f6e9a2e4582b7998f59c2432557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:57.123188 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-f75cd862-9eea-4d97-9cb2-8fcdaed762b9 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] 10.222.0.55 "GET /compute/v2.1/servers/05eb6210-0234-435d-bf80-4e701ec1cc0c" status: 200 len: 1313 microversion: 2.1 time: 0.258992 May 31 21:06:57.141247 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 221/416] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:56 2022] GET /compute/v2.1/servers/05eb6210-0234-435d-bf80-4e701ec1cc0c => generated 1313 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:06:57.252000 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [req-d72dce7e-81ca-4fb6-b6d5-8f996e45061b req-ab208965-d877-4cdd-b823-fd91ada75660 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05eb6210-0234-435d-bf80-4e701ec1cc0c", "name": "network-vif-plugged", "status": "completed", "tag": "ae6376d6-cc5c-4a63-8f01-83c120bb79c6"}]} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:06:57.260945 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-d72dce7e-81ca-4fb6-b6d5-8f996e45061b req-ab208965-d877-4cdd-b823-fd91ada75660 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:57.261393 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-d72dce7e-81ca-4fb6-b6d5-8f996e45061b req-ab208965-d877-4cdd-b823-fd91ada75660 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:57.280857 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.compute.server_external_events [req-d72dce7e-81ca-4fb6-b6d5-8f996e45061b req-ab208965-d877-4cdd-b823-fd91ada75660 service nova] Creating event network-vif-plugged:ae6376d6-cc5c-4a63-8f01-83c120bb79c6 for instance 05eb6210-0234-435d-bf80-4e701ec1cc0c on hv-cinder-83979 May 31 21:06:57.289156 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [req-d72dce7e-81ca-4fb6-b6d5-8f996e45061b req-ab208965-d877-4cdd-b823-fd91ada75660 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041064 May 31 21:06:57.292348 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 196/417] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:06:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:06:58.153247 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-7e4f5501-2e26-48cf-bd94-0424f282f186 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:58.154480 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-7e4f5501-2e26-48cf-bd94-0424f282f186 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] [instance: 05eb6210-0234-435d-bf80-4e701ec1cc0c] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:58.163562 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7e4f5501-2e26-48cf-bd94-0424f282f186 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:58.164642 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7e4f5501-2e26-48cf-bd94-0424f282f186 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:58.166391 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7e4f5501-2e26-48cf-bd94-0424f282f186 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:58.167404 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7e4f5501-2e26-48cf-bd94-0424f282f186 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:58.315169 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-7e4f5501-2e26-48cf-bd94-0424f282f186 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09a42f9bd4f04176bd23a3324f6b4e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6200f6e9a2e4582b7998f59c2432557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:58.323168 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-7e4f5501-2e26-48cf-bd94-0424f282f186 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] 10.222.0.55 "GET /compute/v2.1/servers/05eb6210-0234-435d-bf80-4e701ec1cc0c" status: 200 len: 1313 microversion: 2.1 time: 0.176061 May 31 21:06:58.323753 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 222/418] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:58 2022] GET /compute/v2.1/servers/05eb6210-0234-435d-bf80-4e701ec1cc0c => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:06:59.342881 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-9b4183dc-97c7-4cf0-aca1-e1d984e96bc6 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:06:59.344527 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-9b4183dc-97c7-4cf0-aca1-e1d984e96bc6 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] [instance: 05eb6210-0234-435d-bf80-4e701ec1cc0c] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:06:59.350467 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9b4183dc-97c7-4cf0-aca1-e1d984e96bc6 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:59.350919 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9b4183dc-97c7-4cf0-aca1-e1d984e96bc6 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:59.351685 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9b4183dc-97c7-4cf0-aca1-e1d984e96bc6 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:06:59.352112 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9b4183dc-97c7-4cf0-aca1-e1d984e96bc6 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:06:59.546934 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-9b4183dc-97c7-4cf0-aca1-e1d984e96bc6 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09a42f9bd4f04176bd23a3324f6b4e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6200f6e9a2e4582b7998f59c2432557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:06:59.557847 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-9b4183dc-97c7-4cf0-aca1-e1d984e96bc6 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] 10.222.0.55 "GET /compute/v2.1/servers/05eb6210-0234-435d-bf80-4e701ec1cc0c" status: 200 len: 1313 microversion: 2.1 time: 0.220274 May 31 21:06:59.558650 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 197/419] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:06:59 2022] GET /compute/v2.1/servers/05eb6210-0234-435d-bf80-4e701ec1cc0c => generated 1313 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:07:00.585622 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-d52157cb-c99f-421f-b6af-22225a8a75d9 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:00.586269 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-d52157cb-c99f-421f-b6af-22225a8a75d9 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] [instance: 05eb6210-0234-435d-bf80-4e701ec1cc0c] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:00.594653 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d52157cb-c99f-421f-b6af-22225a8a75d9 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:00.595299 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d52157cb-c99f-421f-b6af-22225a8a75d9 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:00.596310 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d52157cb-c99f-421f-b6af-22225a8a75d9 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:00.597014 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d52157cb-c99f-421f-b6af-22225a8a75d9 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:00.761475 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-d52157cb-c99f-421f-b6af-22225a8a75d9 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09a42f9bd4f04176bd23a3324f6b4e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6200f6e9a2e4582b7998f59c2432557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:00.769300 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-d52157cb-c99f-421f-b6af-22225a8a75d9 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] 10.222.0.55 "GET /compute/v2.1/servers/05eb6210-0234-435d-bf80-4e701ec1cc0c" status: 200 len: 1463 microversion: 2.1 time: 0.197045 May 31 21:07:00.769930 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 223/420] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:07:00 2022] GET /compute/v2.1/servers/05eb6210-0234-435d-bf80-4e701ec1cc0c => generated 1463 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:07:00.831915 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-77575b4a-0830-4f0a-a02d-9005a2548368 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:00.833429 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-77575b4a-0830-4f0a-a02d-9005a2548368 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] [instance: 05eb6210-0234-435d-bf80-4e701ec1cc0c] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:00.839158 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_api:SELECT=50 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:00.842339 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-77575b4a-0830-4f0a-a02d-9005a2548368 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:00.843072 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-77575b4a-0830-4f0a-a02d-9005a2548368 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:00.843859 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-77575b4a-0830-4f0a-a02d-9005a2548368 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:00.844321 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-77575b4a-0830-4f0a-a02d-9005a2548368 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:00.871867 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-77575b4a-0830-4f0a-a02d-9005a2548368 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] [instance: 05eb6210-0234-435d-bf80-4e701ec1cc0c] Going to try to terminate instance {{(pid=118185) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 21:07:01.249156 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-77575b4a-0830-4f0a-a02d-9005a2548368 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] 10.222.0.55 "DELETE /compute/v2.1/servers/05eb6210-0234-435d-bf80-4e701ec1cc0c" status: 204 len: 0 microversion: 2.1 time: 0.421773 May 31 21:07:01.249758 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 198/421] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 31 21:07:00 2022] DELETE /compute/v2.1/servers/05eb6210-0234-435d-bf80-4e701ec1cc0c => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 31 21:07:01.260982 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-21616a90-2f6a-43ed-8776-446e12a887c9 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:01.261971 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-21616a90-2f6a-43ed-8776-446e12a887c9 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] [instance: 05eb6210-0234-435d-bf80-4e701ec1cc0c] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:01.272974 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-21616a90-2f6a-43ed-8776-446e12a887c9 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:01.273718 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-21616a90-2f6a-43ed-8776-446e12a887c9 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:01.275623 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-21616a90-2f6a-43ed-8776-446e12a887c9 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:01.276601 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-21616a90-2f6a-43ed-8776-446e12a887c9 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:01.437242 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-21616a90-2f6a-43ed-8776-446e12a887c9 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09a42f9bd4f04176bd23a3324f6b4e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6200f6e9a2e4582b7998f59c2432557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:01.444596 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-21616a90-2f6a-43ed-8776-446e12a887c9 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] 10.222.0.55 "GET /compute/v2.1/servers/05eb6210-0234-435d-bf80-4e701ec1cc0c" status: 200 len: 1469 microversion: 2.1 time: 0.188693 May 31 21:07:01.445211 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 224/422] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:07:01 2022] GET /compute/v2.1/servers/05eb6210-0234-435d-bf80-4e701ec1cc0c => generated 1469 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:07:02.465067 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-ae77dd2b-9090-46bf-b9aa-0026618358f5 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:02.466163 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-ae77dd2b-9090-46bf-b9aa-0026618358f5 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] [instance: 05eb6210-0234-435d-bf80-4e701ec1cc0c] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:02.473774 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ae77dd2b-9090-46bf-b9aa-0026618358f5 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:02.474249 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ae77dd2b-9090-46bf-b9aa-0026618358f5 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:02.475028 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ae77dd2b-9090-46bf-b9aa-0026618358f5 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:02.475461 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ae77dd2b-9090-46bf-b9aa-0026618358f5 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:02.618253 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-ae77dd2b-9090-46bf-b9aa-0026618358f5 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09a42f9bd4f04176bd23a3324f6b4e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6200f6e9a2e4582b7998f59c2432557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:02.626643 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-ae77dd2b-9090-46bf-b9aa-0026618358f5 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] 10.222.0.55 "GET /compute/v2.1/servers/05eb6210-0234-435d-bf80-4e701ec1cc0c" status: 200 len: 1469 microversion: 2.1 time: 0.166235 May 31 21:07:02.627248 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 199/423] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:07:02 2022] GET /compute/v2.1/servers/05eb6210-0234-435d-bf80-4e701ec1cc0c => generated 1469 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:07:03.646421 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-76de01ab-b470-4ea7-929b-718f78cdbf45 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:03.647753 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-76de01ab-b470-4ea7-929b-718f78cdbf45 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] [instance: 05eb6210-0234-435d-bf80-4e701ec1cc0c] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:03.657952 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-76de01ab-b470-4ea7-929b-718f78cdbf45 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:03.658778 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-76de01ab-b470-4ea7-929b-718f78cdbf45 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:03.662727 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-76de01ab-b470-4ea7-929b-718f78cdbf45 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:03.662727 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-76de01ab-b470-4ea7-929b-718f78cdbf45 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:03.838199 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-76de01ab-b470-4ea7-929b-718f78cdbf45 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09a42f9bd4f04176bd23a3324f6b4e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6200f6e9a2e4582b7998f59c2432557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:03.852799 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-76de01ab-b470-4ea7-929b-718f78cdbf45 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] 10.222.0.55 "GET /compute/v2.1/servers/05eb6210-0234-435d-bf80-4e701ec1cc0c" status: 200 len: 1469 microversion: 2.1 time: 0.210304 May 31 21:07:03.854272 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 225/424] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:07:03 2022] GET /compute/v2.1/servers/05eb6210-0234-435d-bf80-4e701ec1cc0c => generated 1469 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:07:04.023045 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [req-2fb3e41e-cb89-4b62-876b-18089193e167 req-55e6dd78-d35c-45b3-a13a-1a57e5e610d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05eb6210-0234-435d-bf80-4e701ec1cc0c", "name": "network-vif-deleted", "tag": "ae6376d6-cc5c-4a63-8f01-83c120bb79c6"}]} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:07:04.040790 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-e2382802-77de-4f9a-80a4-5e84c7a7ad6c tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1571497661", "imageRef": "21b89996-9e87-489d-8891-305f6c3d905a", "flavorRef": "452", "networks": [{"uuid": "31d0d2cb-3b54-4c55-b456-24ad3c7e1be7"}]}} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:07:04.045705 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-2fb3e41e-cb89-4b62-876b-18089193e167 req-55e6dd78-d35c-45b3-a13a-1a57e5e610d3 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:04.046303 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-2fb3e41e-cb89-4b62-876b-18089193e167 req-55e6dd78-d35c-45b3-a13a-1a57e5e610d3 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:04.060532 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.compute.server_external_events [req-2fb3e41e-cb89-4b62-876b-18089193e167 req-55e6dd78-d35c-45b3-a13a-1a57e5e610d3 service nova] Creating event network-vif-deleted:ae6376d6-cc5c-4a63-8f01-83c120bb79c6 for instance 05eb6210-0234-435d-bf80-4e701ec1cc0c on hv-cinder-83979 May 31 21:07:04.075737 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [req-2fb3e41e-cb89-4b62-876b-18089193e167 req-55e6dd78-d35c-45b3-a13a-1a57e5e610d3 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052750 May 31 21:07:04.075737 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 200/425] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:07:04.109966 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.network.neutron [None req-e2382802-77de-4f9a-80a4-5e84c7a7ad6c tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] validate_networks() for [('31d0d2cb-3b54-4c55-b456-24ad3c7e1be7', None, None, None, None, None)] {{(pid=118184) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 21:07:04.326808 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-f402beb8-0bff-4837-af0f-b9b0fb6ec227 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:04.327757 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-f402beb8-0bff-4837-af0f-b9b0fb6ec227 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:04.334774 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f402beb8-0bff-4837-af0f-b9b0fb6ec227 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:04.335228 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f402beb8-0bff-4837-af0f-b9b0fb6ec227 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:04.336015 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f402beb8-0bff-4837-af0f-b9b0fb6ec227 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:04.336443 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f402beb8-0bff-4837-af0f-b9b0fb6ec227 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:04.567185 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-f402beb8-0bff-4837-af0f-b9b0fb6ec227 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:04.575859 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-f402beb8-0bff-4837-af0f-b9b0fb6ec227 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1593 microversion: 2.1 time: 0.253717 May 31 21:07:04.576457 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 201/426] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:07:04 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1593 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:07:04.612811 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.virt.hardware [None req-e2382802-77de-4f9a-80a4-5e84c7a7ad6c tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Flavor limits 0:0:0 {{(pid=118184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 21:07:04.612811 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.virt.hardware [None req-e2382802-77de-4f9a-80a4-5e84c7a7ad6c tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Image limits 0:0:0 {{(pid=118184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 21:07:04.613020 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.virt.hardware [None req-e2382802-77de-4f9a-80a4-5e84c7a7ad6c tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Flavor pref 0:0:0 {{(pid=118184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 21:07:04.615235 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.virt.hardware [None req-e2382802-77de-4f9a-80a4-5e84c7a7ad6c tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Image pref 0:0:0 {{(pid=118184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 21:07:04.615235 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.virt.hardware [None req-e2382802-77de-4f9a-80a4-5e84c7a7ad6c tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 21:07:04.625762 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e2382802-77de-4f9a-80a4-5e84c7a7ad6c tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:04.626241 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e2382802-77de-4f9a-80a4-5e84c7a7ad6c tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:04.627037 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e2382802-77de-4f9a-80a4-5e84c7a7ad6c tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:04.627465 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e2382802-77de-4f9a-80a4-5e84c7a7ad6c tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:04.645859 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.quota [None req-e2382802-77de-4f9a-80a4-5e84c7a7ad6c tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Getting quotas for project f722e284eda84b078c1c6935fb728f82. Resources: {'ram', 'cores', 'instances'} {{(pid=118184) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 21:07:04.650069 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.quota [None req-e2382802-77de-4f9a-80a4-5e84c7a7ad6c tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Getting quotas for user 757f0e0a07754669b7cb9f21502e5906 and project f722e284eda84b078c1c6935fb728f82. Resources: {'ram', 'cores', 'instances'} {{(pid=118184) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 21:07:04.662437 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-e2382802-77de-4f9a-80a4-5e84c7a7ad6c tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Going to run 1 instances... {{(pid=118184) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 21:07:04.664810 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-e2382802-77de-4f9a-80a4-5e84c7a7ad6c tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] [instance: fb77423f-1f79-41ab-92bc-d77a2132d34a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='21b89996-9e87-489d-8891-305f6c3d905a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118184) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 21:07:04.804212 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-e2382802-77de-4f9a-80a4-5e84c7a7ad6c tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.767547 May 31 21:07:04.806111 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 226/427] 10.222.0.55 () {60 vars in 1146 bytes} [Tue May 31 21:07:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 773 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 31 21:07:04.820165 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-085d81c3-0318-412e-bd79-44377a34bdda tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:04.821321 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-085d81c3-0318-412e-bd79-44377a34bdda tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] [instance: fb77423f-1f79-41ab-92bc-d77a2132d34a] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:04.870044 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-61a51bd9-021c-4ff1-ab82-0bf2a3ca7d4d tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:04.870747 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-61a51bd9-021c-4ff1-ab82-0bf2a3ca7d4d tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] [instance: 05eb6210-0234-435d-bf80-4e701ec1cc0c] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:04.880958 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-61a51bd9-021c-4ff1-ab82-0bf2a3ca7d4d tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:04.881543 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-61a51bd9-021c-4ff1-ab82-0bf2a3ca7d4d tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:04.882492 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-61a51bd9-021c-4ff1-ab82-0bf2a3ca7d4d tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:04.883094 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-61a51bd9-021c-4ff1-ab82-0bf2a3ca7d4d tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:04.902020 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-085d81c3-0318-412e-bd79-44377a34bdda tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f0e0a07754669b7cb9f21502e5906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f722e284eda84b078c1c6935fb728f82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:04.909415 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-085d81c3-0318-412e-bd79-44377a34bdda tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] 10.222.0.55 "GET /compute/v2.1/servers/fb77423f-1f79-41ab-92bc-d77a2132d34a" status: 200 len: 1214 microversion: 2.1 time: 0.095172 May 31 21:07:04.910872 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 202/428] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:07:04 2022] GET /compute/v2.1/servers/fb77423f-1f79-41ab-92bc-d77a2132d34a => generated 1214 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:07:04.928022 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-61a51bd9-021c-4ff1-ab82-0bf2a3ca7d4d tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:04.928022 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-61a51bd9-021c-4ff1-ab82-0bf2a3ca7d4d tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:04.928022 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.objects.instance [None req-61a51bd9-021c-4ff1-ab82-0bf2a3ca7d4d tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lazy-loading 'fault' on Instance uuid 05eb6210-0234-435d-bf80-4e701ec1cc0c {{(pid=118184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 21:07:05.003045 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-61a51bd9-021c-4ff1-ab82-0bf2a3ca7d4d tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09a42f9bd4f04176bd23a3324f6b4e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6200f6e9a2e4582b7998f59c2432557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:05.018884 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-61a51bd9-021c-4ff1-ab82-0bf2a3ca7d4d tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] 10.222.0.55 "GET /compute/v2.1/servers/05eb6210-0234-435d-bf80-4e701ec1cc0c" status: 200 len: 1303 microversion: 2.1 time: 0.152659 May 31 21:07:05.019849 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 227/429] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:07:04 2022] GET /compute/v2.1/servers/05eb6210-0234-435d-bf80-4e701ec1cc0c => generated 1303 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:07:05.933159 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-8b46fb9a-796f-4869-aa9b-fffa119b9d4e tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:05.934486 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-8b46fb9a-796f-4869-aa9b-fffa119b9d4e tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] [instance: fb77423f-1f79-41ab-92bc-d77a2132d34a] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:06.015789 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-8b46fb9a-796f-4869-aa9b-fffa119b9d4e tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f0e0a07754669b7cb9f21502e5906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f722e284eda84b078c1c6935fb728f82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:06.023236 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-8b46fb9a-796f-4869-aa9b-fffa119b9d4e tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] 10.222.0.55 "GET /compute/v2.1/servers/fb77423f-1f79-41ab-92bc-d77a2132d34a" status: 200 len: 1214 microversion: 2.1 time: 0.096302 May 31 21:07:06.023785 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 203/430] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:07:05 2022] GET /compute/v2.1/servers/fb77423f-1f79-41ab-92bc-d77a2132d34a => generated 1214 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:07:06.037048 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-7e8d7a51-abe5-4bf7-bd39-5efa15f6ae79 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:06.037658 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-7e8d7a51-abe5-4bf7-bd39-5efa15f6ae79 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] [instance: 05eb6210-0234-435d-bf80-4e701ec1cc0c] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:06.044737 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7e8d7a51-abe5-4bf7-bd39-5efa15f6ae79 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:06.046558 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7e8d7a51-abe5-4bf7-bd39-5efa15f6ae79 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:06.046558 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7e8d7a51-abe5-4bf7-bd39-5efa15f6ae79 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:06.046558 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7e8d7a51-abe5-4bf7-bd39-5efa15f6ae79 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:06.060503 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.wsgi [None req-7e8d7a51-abe5-4bf7-bd39-5efa15f6ae79 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] HTTP exception thrown: Instance 05eb6210-0234-435d-bf80-4e701ec1cc0c could not be found. May 31 21:07:06.062295 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-7e8d7a51-abe5-4bf7-bd39-5efa15f6ae79 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Request method failure captured: May 31 21:07:06.062295 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: request: GET /compute/v2.1/servers/05eb6210-0234-435d-bf80-4e701ec1cc0c HTTP/1.1 May 31 21:07:06.062295 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Accept: application/json May 31 21:07:06.062295 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Accept-Encoding: identity May 31 21:07:06.062295 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Connection: close May 31 21:07:06.062295 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Content-Length: 0 May 31 21:07:06.062295 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Content-Type: application/json May 31 21:07:06.062295 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Host: 10.222.0.55 May 31 21:07:06.062295 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Openstack-System-Scope: None May 31 21:07:06.062295 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: User-Agent: python-urllib3/1.26.9 May 31 21:07:06.062295 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Auth-Token: gAAAAABiloNSnZT8r440m9jVF75YEuYq849wWS838qE6Lw8EgCyDvtNCtLe0YGeODwIN39l_49-zHHgK2DJx692y09_Gfeh9n6DgFxae5ha1LBlWrwFHPG8Egq5l-XTK3hcopnFiQqRznVV4yeXI78nmq2Y5Ps_TBdEQdzTM2jDNNPIvJCfuxSk May 31 21:07:06.062295 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Domain-Id: None May 31 21:07:06.062295 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Domain-Name: None May 31 21:07:06.062295 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Identity-Status: Confirmed May 31 21:07:06.062295 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Is-Admin-Project: True May 31 21:07:06.062295 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Domain-Id: default May 31 21:07:06.062295 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Domain-Name: Default May 31 21:07:06.062295 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Id: c6200f6e9a2e4582b7998f59c2432557 May 31 21:07:06.062295 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Name: tempest-VolumesNegativeTest-497800974 May 31 21:07:06.062295 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Role: member,reader May 31 21:07:06.062295 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Roles: member,reader May 31 21:07:06.063668 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/c6200f6e9a2e4582b7998f59c2432557"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/c6200f6e9a2e4582b7998f59c2432557"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_c6200f6e9a2e4582b7998f59c2432557", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/c6200f6e9a2e4582b7998f59c2432557"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] May 31 21:07:06.063668 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant: tempest-VolumesNegativeTest-497800974 May 31 21:07:06.063668 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant-Id: c6200f6e9a2e4582b7998f59c2432557 May 31 21:07:06.063668 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant-Name: tempest-VolumesNegativeTest-497800974 May 31 21:07:06.063668 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User: tempest-VolumesNegativeTest-497800974-project May 31 21:07:06.063668 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Domain-Id: default May 31 21:07:06.063668 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Domain-Name: Default May 31 21:07:06.063668 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Id: 09a42f9bd4f04176bd23a3324f6b4e8e May 31 21:07:06.063668 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Name: tempest-VolumesNegativeTest-497800974-project May 31 21:07:06.063668 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: method: > May 31 21:07:06.063668 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: exception: Instance 05eb6210-0234-435d-bf80-4e701ec1cc0c could not be found. May 31 21:07:06.063668 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: action_args: {'id': '05eb6210-0234-435d-bf80-4e701ec1cc0c'} May 31 21:07:06.064529 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 21:07:06.064529 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:07:06.064529 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 21:07:06.064529 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 21:07:06.064529 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 21:07:06.064529 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 21:07:06.064529 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 21:07:06.064529 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 21:07:06.064529 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 21:07:06.064529 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 21:07:06.064529 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05eb6210-0234-435d-bf80-4e701ec1cc0c could not be found. May 31 21:07:06.064529 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:07:06.064529 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:07:06.064529 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:07:06.064529 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:07:06.064529 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:07:06.064529 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:07:06.064529 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 21:07:06.064529 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 21:07:06.064529 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 21:07:06.065859 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 21:07:06.065859 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 21:07:06.065859 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 21:07:06.065859 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 21:07:06.065859 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 21:07:06.065859 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 21:07:06.065859 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 21:07:06.065859 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05eb6210-0234-435d-bf80-4e701ec1cc0c could not be found. May 31 21:07:06.065859 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:07:06.065859 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:07:06.065859 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:07:06.065859 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:07:06.065859 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:07:06.065859 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:07:06.065859 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 21:07:06.065859 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 21:07:06.065859 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05eb6210-0234-435d-bf80-4e701ec1cc0c could not be found. May 31 21:07:06.065859 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:07:06.067171 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-7e8d7a51-abe5-4bf7-bd39-5efa15f6ae79 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] Returning 404 to user: Instance 05eb6210-0234-435d-bf80-4e701ec1cc0c could not be found. {{(pid=118184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 21:07:06.067171 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-7e8d7a51-abe5-4bf7-bd39-5efa15f6ae79 tempest-VolumesNegativeTest-497800974 tempest-VolumesNegativeTest-497800974-project] 10.222.0.55 "GET /compute/v2.1/servers/05eb6210-0234-435d-bf80-4e701ec1cc0c" status: 404 len: 111 microversion: 2.1 time: 0.030752 May 31 21:07:06.067171 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 228/431] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:07:06 2022] GET /compute/v2.1/servers/05eb6210-0234-435d-bf80-4e701ec1cc0c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 21:07:07.042366 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-2117e8a1-ff8b-4d39-b0cb-8a06843c934e tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:07.044135 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-2117e8a1-ff8b-4d39-b0cb-8a06843c934e tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] [instance: fb77423f-1f79-41ab-92bc-d77a2132d34a] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:07.054940 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-2117e8a1-ff8b-4d39-b0cb-8a06843c934e tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:07.055891 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-2117e8a1-ff8b-4d39-b0cb-8a06843c934e tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:07.057292 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-2117e8a1-ff8b-4d39-b0cb-8a06843c934e tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:07.058010 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-2117e8a1-ff8b-4d39-b0cb-8a06843c934e tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:07.143670 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-2117e8a1-ff8b-4d39-b0cb-8a06843c934e tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f0e0a07754669b7cb9f21502e5906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f722e284eda84b078c1c6935fb728f82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:07.159016 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-2117e8a1-ff8b-4d39-b0cb-8a06843c934e tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] 10.222.0.55 "GET /compute/v2.1/servers/fb77423f-1f79-41ab-92bc-d77a2132d34a" status: 200 len: 1218 microversion: 2.1 time: 0.121469 May 31 21:07:07.160123 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 204/432] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:07:07 2022] GET /compute/v2.1/servers/fb77423f-1f79-41ab-92bc-d77a2132d34a => generated 1218 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:07:07.527023 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [req-fe0ae99b-2c39-4312-836a-5f9f2f17dc3e req-a638b819-6cc1-4b5f-acac-3166e7754982 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "979133c4-01ae-4510-8d70-018170135a6c", "tag": "6ba426b9-2ac4-463e-bc64-9ae379649087"}]} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:07:07.554149 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-fe0ae99b-2c39-4312-836a-5f9f2f17dc3e req-a638b819-6cc1-4b5f-acac-3166e7754982 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:07.555171 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-fe0ae99b-2c39-4312-836a-5f9f2f17dc3e req-a638b819-6cc1-4b5f-acac-3166e7754982 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:07.591315 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.compute.server_external_events [req-fe0ae99b-2c39-4312-836a-5f9f2f17dc3e req-a638b819-6cc1-4b5f-acac-3166e7754982 service nova] Creating event network-changed:6ba426b9-2ac4-463e-bc64-9ae379649087 for instance 979133c4-01ae-4510-8d70-018170135a6c on hv-cinder-83979 May 31 21:07:07.612034 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [req-fe0ae99b-2c39-4312-836a-5f9f2f17dc3e req-a638b819-6cc1-4b5f-acac-3166e7754982 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091944 May 31 21:07:07.612813 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 229/433] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:07:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:07:08.182353 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-1c62fe9c-d463-4caa-8c76-775d8d5cdb7e tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:08.184997 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-1c62fe9c-d463-4caa-8c76-775d8d5cdb7e tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] [instance: fb77423f-1f79-41ab-92bc-d77a2132d34a] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:08.197291 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-1c62fe9c-d463-4caa-8c76-775d8d5cdb7e tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:08.198750 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-1c62fe9c-d463-4caa-8c76-775d8d5cdb7e tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:08.200994 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-1c62fe9c-d463-4caa-8c76-775d8d5cdb7e tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:08.202055 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-1c62fe9c-d463-4caa-8c76-775d8d5cdb7e tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:08.322368 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-1c62fe9c-d463-4caa-8c76-775d8d5cdb7e tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f0e0a07754669b7cb9f21502e5906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f722e284eda84b078c1c6935fb728f82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:08.340133 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-1c62fe9c-d463-4caa-8c76-775d8d5cdb7e tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] 10.222.0.55 "GET /compute/v2.1/servers/fb77423f-1f79-41ab-92bc-d77a2132d34a" status: 200 len: 1266 microversion: 2.1 time: 0.165817 May 31 21:07:08.341386 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 205/434] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:07:08 2022] GET /compute/v2.1/servers/fb77423f-1f79-41ab-92bc-d77a2132d34a => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:07:09.359359 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-66dbbb79-8039-4229-8863-6dadfe661ffd tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:09.360087 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-66dbbb79-8039-4229-8863-6dadfe661ffd tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] [instance: fb77423f-1f79-41ab-92bc-d77a2132d34a] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:09.367151 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-66dbbb79-8039-4229-8863-6dadfe661ffd tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:09.367645 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-66dbbb79-8039-4229-8863-6dadfe661ffd tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:09.368439 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-66dbbb79-8039-4229-8863-6dadfe661ffd tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:09.368881 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-66dbbb79-8039-4229-8863-6dadfe661ffd tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:09.436360 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-66dbbb79-8039-4229-8863-6dadfe661ffd tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f0e0a07754669b7cb9f21502e5906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f722e284eda84b078c1c6935fb728f82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:09.443999 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-66dbbb79-8039-4229-8863-6dadfe661ffd tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] 10.222.0.55 "GET /compute/v2.1/servers/fb77423f-1f79-41ab-92bc-d77a2132d34a" status: 200 len: 1266 microversion: 2.1 time: 0.090140 May 31 21:07:09.444588 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 230/435] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:07:09 2022] GET /compute/v2.1/servers/fb77423f-1f79-41ab-92bc-d77a2132d34a => generated 1266 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:07:10.461406 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-bfdca8df-13cc-45a8-bdee-6467360f8f47 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:10.462052 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-bfdca8df-13cc-45a8-bdee-6467360f8f47 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] [instance: fb77423f-1f79-41ab-92bc-d77a2132d34a] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:10.468974 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-bfdca8df-13cc-45a8-bdee-6467360f8f47 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:10.469430 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-bfdca8df-13cc-45a8-bdee-6467360f8f47 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:10.470257 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-bfdca8df-13cc-45a8-bdee-6467360f8f47 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:10.470703 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-bfdca8df-13cc-45a8-bdee-6467360f8f47 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:10.551954 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-bfdca8df-13cc-45a8-bdee-6467360f8f47 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f0e0a07754669b7cb9f21502e5906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f722e284eda84b078c1c6935fb728f82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:10.560917 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-bfdca8df-13cc-45a8-bdee-6467360f8f47 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] 10.222.0.55 "GET /compute/v2.1/servers/fb77423f-1f79-41ab-92bc-d77a2132d34a" status: 200 len: 1266 microversion: 2.1 time: 0.103656 May 31 21:07:10.561545 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 206/436] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:07:10 2022] GET /compute/v2.1/servers/fb77423f-1f79-41ab-92bc-d77a2132d34a => generated 1266 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:07:10.797196 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-07944de8-b90a-4ca7-8923-5c9230cfb2c8 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1064894292"}} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:07:10.804069 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-07944de8-b90a-4ca7-8923-5c9230cfb2c8 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:10.805327 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-07944de8-b90a-4ca7-8923-5c9230cfb2c8 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:10.806083 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-07944de8-b90a-4ca7-8923-5c9230cfb2c8 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:10.806583 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-07944de8-b90a-4ca7-8923-5c9230cfb2c8 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:10.807386 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-07944de8-b90a-4ca7-8923-5c9230cfb2c8 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:10.957572 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.network.security_group_api [None req-07944de8-b90a-4ca7-8923-5c9230cfb2c8 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Adding security group 4ed228bd-5021-4a8b-93b3-efccb0105eda to port 6ba426b9-2ac4-463e-bc64-9ae379649087 May 31 21:07:11.113780 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-b02ec3c7-dcc6-497b-a897-c06b253d9311 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:11.114656 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-b02ec3c7-dcc6-497b-a897-c06b253d9311 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:11.122021 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b02ec3c7-dcc6-497b-a897-c06b253d9311 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:11.122726 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b02ec3c7-dcc6-497b-a897-c06b253d9311 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:11.123669 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b02ec3c7-dcc6-497b-a897-c06b253d9311 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:11.124264 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b02ec3c7-dcc6-497b-a897-c06b253d9311 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:11.150517 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-b02ec3c7-dcc6-497b-a897-c06b253d9311 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd/ips" status: 200 len: 152 microversion: 2.20 time: 0.041686 May 31 21:07:11.151613 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 207/437] 10.222.0.55 () {60 vars in 1288 bytes} [Tue May 31 21:07:11 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd/ips => generated 152 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 21:07:11.578166 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-eea79f6e-8990-46b7-8762-82041c4b08d6 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:11.579000 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-07944de8-b90a-4ca7-8923-5c9230cfb2c8 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "POST /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c/action" status: 202 len: 0 microversion: 2.1 time: 0.786679 May 31 21:07:11.579861 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-eea79f6e-8990-46b7-8762-82041c4b08d6 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] [instance: fb77423f-1f79-41ab-92bc-d77a2132d34a] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:11.580487 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 231/438] 10.222.0.55 () {60 vars in 1277 bytes} [Tue May 31 21:07:10 2022] POST /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c/action => generated 0 bytes in 789 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 31 21:07:11.590921 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-cea6efab-0daa-4c67-8504-0427c585dd43 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:11.591779 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-cea6efab-0daa-4c67-8504-0427c585dd43 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:11.602387 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-eea79f6e-8990-46b7-8762-82041c4b08d6 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:11.607218 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-cea6efab-0daa-4c67-8504-0427c585dd43 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:11.612803 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-cea6efab-0daa-4c67-8504-0427c585dd43 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:11.613214 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-eea79f6e-8990-46b7-8762-82041c4b08d6 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:11.613317 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-cea6efab-0daa-4c67-8504-0427c585dd43 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:11.613408 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-eea79f6e-8990-46b7-8762-82041c4b08d6 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:11.613500 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-cea6efab-0daa-4c67-8504-0427c585dd43 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:11.613600 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-eea79f6e-8990-46b7-8762-82041c4b08d6 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:11.862965 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-eea79f6e-8990-46b7-8762-82041c4b08d6 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f0e0a07754669b7cb9f21502e5906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f722e284eda84b078c1c6935fb728f82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:11.869359 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:11.880340 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-eea79f6e-8990-46b7-8762-82041c4b08d6 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] 10.222.0.55 "GET /compute/v2.1/servers/fb77423f-1f79-41ab-92bc-d77a2132d34a" status: 200 len: 1266 microversion: 2.1 time: 0.304821 May 31 21:07:11.884295 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 208/439] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:07:11 2022] GET /compute/v2.1/servers/fb77423f-1f79-41ab-92bc-d77a2132d34a => generated 1266 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:07:11.904254 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [req-7db5a92e-88eb-4d2f-b9ff-b7ad60bb6280 req-584fc032-4d22-4e79-b0d8-17acba3b49ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "979133c4-01ae-4510-8d70-018170135a6c", "tag": "6ba426b9-2ac4-463e-bc64-9ae379649087"}]} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:07:11.932741 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-7db5a92e-88eb-4d2f-b9ff-b7ad60bb6280 req-584fc032-4d22-4e79-b0d8-17acba3b49ce service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:11.933468 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-7db5a92e-88eb-4d2f-b9ff-b7ad60bb6280 req-584fc032-4d22-4e79-b0d8-17acba3b49ce service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:11.973035 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.compute.server_external_events [req-7db5a92e-88eb-4d2f-b9ff-b7ad60bb6280 req-584fc032-4d22-4e79-b0d8-17acba3b49ce service nova] Creating event network-changed:6ba426b9-2ac4-463e-bc64-9ae379649087 for instance 979133c4-01ae-4510-8d70-018170135a6c on hv-cinder-83979 May 31 21:07:12.009286 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [req-7db5a92e-88eb-4d2f-b9ff-b7ad60bb6280 req-584fc032-4d22-4e79-b0d8-17acba3b49ce service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119519 May 31 21:07:12.011313 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 209/440] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:07:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:07:12.025636 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-cea6efab-0daa-4c67-8504-0427c585dd43 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:12.048926 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-cea6efab-0daa-4c67-8504-0427c585dd43 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1640 microversion: 2.1 time: 0.463457 May 31 21:07:12.062261 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 232/441] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:07:11 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1640 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:07:12.904516 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-44e539fc-09eb-4ef8-8e0f-ff1cf771d4ca tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:12.905933 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-44e539fc-09eb-4ef8-8e0f-ff1cf771d4ca tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] [instance: fb77423f-1f79-41ab-92bc-d77a2132d34a] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:12.914654 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-44e539fc-09eb-4ef8-8e0f-ff1cf771d4ca tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:12.915250 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-44e539fc-09eb-4ef8-8e0f-ff1cf771d4ca tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:12.916179 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-44e539fc-09eb-4ef8-8e0f-ff1cf771d4ca tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:12.916694 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-44e539fc-09eb-4ef8-8e0f-ff1cf771d4ca tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:13.001840 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-44e539fc-09eb-4ef8-8e0f-ff1cf771d4ca tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f0e0a07754669b7cb9f21502e5906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f722e284eda84b078c1c6935fb728f82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:13.007978 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-44e539fc-09eb-4ef8-8e0f-ff1cf771d4ca tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] 10.222.0.55 "GET /compute/v2.1/servers/fb77423f-1f79-41ab-92bc-d77a2132d34a" status: 200 len: 1272 microversion: 2.1 time: 0.108851 May 31 21:07:13.008879 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 210/442] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:07:12 2022] GET /compute/v2.1/servers/fb77423f-1f79-41ab-92bc-d77a2132d34a => generated 1272 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:07:14.038108 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-a349d1c7-cb68-478b-9af1-ffe5fb925b54 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:14.039192 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-a349d1c7-cb68-478b-9af1-ffe5fb925b54 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] [instance: fb77423f-1f79-41ab-92bc-d77a2132d34a] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:14.052650 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a349d1c7-cb68-478b-9af1-ffe5fb925b54 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:14.053444 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a349d1c7-cb68-478b-9af1-ffe5fb925b54 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:14.054848 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a349d1c7-cb68-478b-9af1-ffe5fb925b54 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:14.055679 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a349d1c7-cb68-478b-9af1-ffe5fb925b54 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:14.220009 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-a349d1c7-cb68-478b-9af1-ffe5fb925b54 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f0e0a07754669b7cb9f21502e5906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f722e284eda84b078c1c6935fb728f82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:14.228387 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-a349d1c7-cb68-478b-9af1-ffe5fb925b54 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] 10.222.0.55 "GET /compute/v2.1/servers/fb77423f-1f79-41ab-92bc-d77a2132d34a" status: 200 len: 1314 microversion: 2.1 time: 0.199080 May 31 21:07:14.234419 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 233/443] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:07:14 2022] GET /compute/v2.1/servers/fb77423f-1f79-41ab-92bc-d77a2132d34a => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:07:14.768851 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [req-7a989be6-1820-43f2-af76-fa540ac1c246 req-f39a1434-9589-41f0-adaa-e582417d404b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb77423f-1f79-41ab-92bc-d77a2132d34a", "tag": "c8c58b45-478b-4e5e-be1e-25170921559d"}]} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:07:14.780495 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-7a989be6-1820-43f2-af76-fa540ac1c246 req-f39a1434-9589-41f0-adaa-e582417d404b service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:14.781009 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-7a989be6-1820-43f2-af76-fa540ac1c246 req-f39a1434-9589-41f0-adaa-e582417d404b service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:14.796459 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.compute.server_external_events [req-7a989be6-1820-43f2-af76-fa540ac1c246 req-f39a1434-9589-41f0-adaa-e582417d404b service nova] Creating event network-changed:c8c58b45-478b-4e5e-be1e-25170921559d for instance fb77423f-1f79-41ab-92bc-d77a2132d34a on hv-cinder-83979 May 31 21:07:14.802213 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [req-7a989be6-1820-43f2-af76-fa540ac1c246 req-f39a1434-9589-41f0-adaa-e582417d404b service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038339 May 31 21:07:14.802821 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 211/444] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:07:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:07:15.151261 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-e44763a8-4f30-4cc3-8f2e-e39488a0012d tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:07:15.153515 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-e44763a8-4f30-4cc3-8f2e-e39488a0012d tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:15.156973 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell0:SELECT=2 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:15.158033 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell0:SELECT=6 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:15.165382 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e44763a8-4f30-4cc3-8f2e-e39488a0012d tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:15.166144 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e44763a8-4f30-4cc3-8f2e-e39488a0012d tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:15.168198 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e44763a8-4f30-4cc3-8f2e-e39488a0012d tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:15.168198 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e44763a8-4f30-4cc3-8f2e-e39488a0012d tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:15.222747 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.objects.instance [None req-e44763a8-4f30-4cc3-8f2e-e39488a0012d tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lazy-loading 'flavor' on Instance uuid a123764b-4693-41b1-bad8-a1a63cc951cd {{(pid=118184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 21:07:15.250360 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-e025651f-26db-425b-8137-9e3ef3a7e27a tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:15.251136 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-e025651f-26db-425b-8137-9e3ef3a7e27a tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] [instance: fb77423f-1f79-41ab-92bc-d77a2132d34a] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:15.258408 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e025651f-26db-425b-8137-9e3ef3a7e27a tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:15.258946 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e025651f-26db-425b-8137-9e3ef3a7e27a tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:15.259792 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e025651f-26db-425b-8137-9e3ef3a7e27a tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:15.260236 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e025651f-26db-425b-8137-9e3ef3a7e27a tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:15.448768 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-e025651f-26db-425b-8137-9e3ef3a7e27a tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f0e0a07754669b7cb9f21502e5906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f722e284eda84b078c1c6935fb728f82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:15.474624 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-e025651f-26db-425b-8137-9e3ef3a7e27a tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] 10.222.0.55 "GET /compute/v2.1/servers/fb77423f-1f79-41ab-92bc-d77a2132d34a" status: 200 len: 1314 microversion: 2.1 time: 0.230437 May 31 21:07:15.475421 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 212/445] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:07:15 2022] GET /compute/v2.1/servers/fb77423f-1f79-41ab-92bc-d77a2132d34a => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:07:15.957501 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-e44763a8-4f30-4cc3-8f2e-e39488a0012d tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "POST /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd/action" status: 202 len: 0 microversion: 2.20 time: 0.816447 May 31 21:07:15.959038 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 234/446] 10.222.0.55 () {62 vars in 1318 bytes} [Tue May 31 21:07:15 2022] POST /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd/action => generated 0 bytes in 819 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 31 21:07:15.968722 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-269a6d79-c5a6-446b-9e24-8af471ed0187 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:15.969319 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-269a6d79-c5a6-446b-9e24-8af471ed0187 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:15.976673 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-269a6d79-c5a6-446b-9e24-8af471ed0187 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:15.976966 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-269a6d79-c5a6-446b-9e24-8af471ed0187 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:15.978051 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-269a6d79-c5a6-446b-9e24-8af471ed0187 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:15.978498 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-269a6d79-c5a6-446b-9e24-8af471ed0187 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:16.024950 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell0:SELECT=4 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:16.179529 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-269a6d79-c5a6-446b-9e24-8af471ed0187 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:16.188633 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-269a6d79-c5a6-446b-9e24-8af471ed0187 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:16.190344 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-269a6d79-c5a6-446b-9e24-8af471ed0187 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:16.191725 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-269a6d79-c5a6-446b-9e24-8af471ed0187 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1723 microversion: 2.20 time: 0.226866 May 31 21:07:16.192371 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 213/447] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:07:15 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 21:07:16.501601 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-fa42127c-cda0-4baa-aa70-7e84b0aee88b tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:16.502339 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-fa42127c-cda0-4baa-aa70-7e84b0aee88b tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] [instance: fb77423f-1f79-41ab-92bc-d77a2132d34a] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:16.509097 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-fa42127c-cda0-4baa-aa70-7e84b0aee88b tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:16.509552 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-fa42127c-cda0-4baa-aa70-7e84b0aee88b tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:16.510360 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-fa42127c-cda0-4baa-aa70-7e84b0aee88b tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:16.510794 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-fa42127c-cda0-4baa-aa70-7e84b0aee88b tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:16.704851 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-fa42127c-cda0-4baa-aa70-7e84b0aee88b tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f0e0a07754669b7cb9f21502e5906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f722e284eda84b078c1c6935fb728f82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:16.735674 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-fa42127c-cda0-4baa-aa70-7e84b0aee88b tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] 10.222.0.55 "GET /compute/v2.1/servers/fb77423f-1f79-41ab-92bc-d77a2132d34a" status: 200 len: 1314 microversion: 2.1 time: 0.238620 May 31 21:07:16.754543 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 235/448] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:07:16 2022] GET /compute/v2.1/servers/fb77423f-1f79-41ab-92bc-d77a2132d34a => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:07:17.212145 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-5bfe1081-9ed8-4216-be7e-52891e8ba978 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:17.212754 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-5bfe1081-9ed8-4216-be7e-52891e8ba978 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:17.220105 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-5bfe1081-9ed8-4216-be7e-52891e8ba978 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:17.220557 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-5bfe1081-9ed8-4216-be7e-52891e8ba978 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:17.221586 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-5bfe1081-9ed8-4216-be7e-52891e8ba978 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:17.222077 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-5bfe1081-9ed8-4216-be7e-52891e8ba978 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:17.396060 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-5bfe1081-9ed8-4216-be7e-52891e8ba978 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:17.405830 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-5bfe1081-9ed8-4216-be7e-52891e8ba978 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:17.407806 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-5bfe1081-9ed8-4216-be7e-52891e8ba978 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:17.409262 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-5bfe1081-9ed8-4216-be7e-52891e8ba978 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1723 microversion: 2.20 time: 0.201805 May 31 21:07:17.416163 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 214/449] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:07:17 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1723 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:07:17.766868 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-efb6bcef-a889-461c-96ea-46e624d3cb47 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:17.769173 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-efb6bcef-a889-461c-96ea-46e624d3cb47 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] [instance: fb77423f-1f79-41ab-92bc-d77a2132d34a] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:17.775939 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:17.779003 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-efb6bcef-a889-461c-96ea-46e624d3cb47 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:17.779719 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-efb6bcef-a889-461c-96ea-46e624d3cb47 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:17.780457 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-efb6bcef-a889-461c-96ea-46e624d3cb47 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:17.790113 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-efb6bcef-a889-461c-96ea-46e624d3cb47 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:18.001102 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-efb6bcef-a889-461c-96ea-46e624d3cb47 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f0e0a07754669b7cb9f21502e5906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f722e284eda84b078c1c6935fb728f82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:18.006468 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:18.011085 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-efb6bcef-a889-461c-96ea-46e624d3cb47 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] 10.222.0.55 "GET /compute/v2.1/servers/fb77423f-1f79-41ab-92bc-d77a2132d34a" status: 200 len: 1314 microversion: 2.1 time: 0.248309 May 31 21:07:18.011664 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 236/450] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:07:17 2022] GET /compute/v2.1/servers/fb77423f-1f79-41ab-92bc-d77a2132d34a => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:07:18.434670 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-662cc8ae-ae2e-43f3-8596-bed68e778b7e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:18.446583 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-662cc8ae-ae2e-43f3-8596-bed68e778b7e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:18.450668 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-662cc8ae-ae2e-43f3-8596-bed68e778b7e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:18.451786 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-662cc8ae-ae2e-43f3-8596-bed68e778b7e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:18.453496 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-662cc8ae-ae2e-43f3-8596-bed68e778b7e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:18.454614 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-662cc8ae-ae2e-43f3-8596-bed68e778b7e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:18.643813 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-662cc8ae-ae2e-43f3-8596-bed68e778b7e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:18.652577 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-662cc8ae-ae2e-43f3-8596-bed68e778b7e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:18.654690 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-662cc8ae-ae2e-43f3-8596-bed68e778b7e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:18.655894 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-662cc8ae-ae2e-43f3-8596-bed68e778b7e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1723 microversion: 2.20 time: 0.229716 May 31 21:07:18.656461 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 215/451] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:07:18 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1723 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:07:19.031484 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-d92037fa-3a45-4150-8a76-7d3f092cfd5f tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:19.032078 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-d92037fa-3a45-4150-8a76-7d3f092cfd5f tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] [instance: fb77423f-1f79-41ab-92bc-d77a2132d34a] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:19.040597 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d92037fa-3a45-4150-8a76-7d3f092cfd5f tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:19.041041 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d92037fa-3a45-4150-8a76-7d3f092cfd5f tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:19.041814 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d92037fa-3a45-4150-8a76-7d3f092cfd5f tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:19.042272 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d92037fa-3a45-4150-8a76-7d3f092cfd5f tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:19.298358 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-d92037fa-3a45-4150-8a76-7d3f092cfd5f tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f0e0a07754669b7cb9f21502e5906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f722e284eda84b078c1c6935fb728f82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:19.306842 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-d92037fa-3a45-4150-8a76-7d3f092cfd5f tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] 10.222.0.55 "GET /compute/v2.1/servers/fb77423f-1f79-41ab-92bc-d77a2132d34a" status: 200 len: 1314 microversion: 2.1 time: 0.279731 May 31 21:07:19.307449 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 237/452] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:07:19 2022] GET /compute/v2.1/servers/fb77423f-1f79-41ab-92bc-d77a2132d34a => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:07:19.675525 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-738f4fbb-88e1-4e40-807b-cbd7a11e7828 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:19.676357 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-738f4fbb-88e1-4e40-807b-cbd7a11e7828 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:19.684556 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-738f4fbb-88e1-4e40-807b-cbd7a11e7828 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:19.685093 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-738f4fbb-88e1-4e40-807b-cbd7a11e7828 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:19.686217 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-738f4fbb-88e1-4e40-807b-cbd7a11e7828 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:19.686667 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-738f4fbb-88e1-4e40-807b-cbd7a11e7828 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:19.897887 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-738f4fbb-88e1-4e40-807b-cbd7a11e7828 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:19.906997 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-738f4fbb-88e1-4e40-807b-cbd7a11e7828 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:19.908523 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-738f4fbb-88e1-4e40-807b-cbd7a11e7828 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:19.909737 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-738f4fbb-88e1-4e40-807b-cbd7a11e7828 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1723 microversion: 2.20 time: 0.238448 May 31 21:07:19.910345 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 216/453] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:07:19 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1723 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:07:20.325932 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-04853149-f5c4-4ae9-9326-432cc91e31a9 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:20.326571 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-04853149-f5c4-4ae9-9326-432cc91e31a9 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] [instance: fb77423f-1f79-41ab-92bc-d77a2132d34a] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:20.335005 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-04853149-f5c4-4ae9-9326-432cc91e31a9 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:20.335457 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-04853149-f5c4-4ae9-9326-432cc91e31a9 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:20.336403 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-04853149-f5c4-4ae9-9326-432cc91e31a9 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:20.336834 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-04853149-f5c4-4ae9-9326-432cc91e31a9 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:20.521439 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-04853149-f5c4-4ae9-9326-432cc91e31a9 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f0e0a07754669b7cb9f21502e5906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f722e284eda84b078c1c6935fb728f82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:20.532566 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-04853149-f5c4-4ae9-9326-432cc91e31a9 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] 10.222.0.55 "GET /compute/v2.1/servers/fb77423f-1f79-41ab-92bc-d77a2132d34a" status: 200 len: 1314 microversion: 2.1 time: 0.211891 May 31 21:07:20.533452 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 238/454] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:07:20 2022] GET /compute/v2.1/servers/fb77423f-1f79-41ab-92bc-d77a2132d34a => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:07:20.931671 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-d7303fda-33c8-4788-a228-4e530611af3a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:20.932522 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-d7303fda-33c8-4788-a228-4e530611af3a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:20.944638 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-d7303fda-33c8-4788-a228-4e530611af3a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:20.945237 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-d7303fda-33c8-4788-a228-4e530611af3a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:20.946898 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-d7303fda-33c8-4788-a228-4e530611af3a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:20.946898 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-d7303fda-33c8-4788-a228-4e530611af3a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:21.126730 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-d7303fda-33c8-4788-a228-4e530611af3a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:21.135708 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-d7303fda-33c8-4788-a228-4e530611af3a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:21.137241 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-d7303fda-33c8-4788-a228-4e530611af3a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:21.139212 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-d7303fda-33c8-4788-a228-4e530611af3a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1723 microversion: 2.20 time: 0.213995 May 31 21:07:21.146271 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 217/455] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:07:20 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1723 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:07:21.557375 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-1fed3570-d017-4d71-9547-42f1f69bba01 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:21.558650 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-1fed3570-d017-4d71-9547-42f1f69bba01 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] [instance: fb77423f-1f79-41ab-92bc-d77a2132d34a] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:21.562273 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [req-40564b12-acad-425a-9dd3-43cc430ab637 req-0c3c1509-2946-443e-aaca-780564c086c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb77423f-1f79-41ab-92bc-d77a2132d34a", "name": "network-vif-plugged", "status": "completed", "tag": "c8c58b45-478b-4e5e-be1e-25170921559d"}]} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:07:21.579251 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-1fed3570-d017-4d71-9547-42f1f69bba01 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:21.579710 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-1fed3570-d017-4d71-9547-42f1f69bba01 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:21.580777 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-1fed3570-d017-4d71-9547-42f1f69bba01 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:21.581424 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-1fed3570-d017-4d71-9547-42f1f69bba01 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:21.582375 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-40564b12-acad-425a-9dd3-43cc430ab637 req-0c3c1509-2946-443e-aaca-780564c086c6 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:21.590972 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-40564b12-acad-425a-9dd3-43cc430ab637 req-0c3c1509-2946-443e-aaca-780564c086c6 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:21.599368 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.compute.server_external_events [req-40564b12-acad-425a-9dd3-43cc430ab637 req-0c3c1509-2946-443e-aaca-780564c086c6 service nova] Creating event network-vif-plugged:c8c58b45-478b-4e5e-be1e-25170921559d for instance fb77423f-1f79-41ab-92bc-d77a2132d34a on hv-cinder-83979 May 31 21:07:21.606590 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [req-40564b12-acad-425a-9dd3-43cc430ab637 req-0c3c1509-2946-443e-aaca-780564c086c6 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054488 May 31 21:07:21.607568 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 218/456] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:07:21.793040 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-1fed3570-d017-4d71-9547-42f1f69bba01 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f0e0a07754669b7cb9f21502e5906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f722e284eda84b078c1c6935fb728f82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:21.803081 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-1fed3570-d017-4d71-9547-42f1f69bba01 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] 10.222.0.55 "GET /compute/v2.1/servers/fb77423f-1f79-41ab-92bc-d77a2132d34a" status: 200 len: 1314 microversion: 2.1 time: 0.255422 May 31 21:07:21.803665 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 239/457] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:07:21 2022] GET /compute/v2.1/servers/fb77423f-1f79-41ab-92bc-d77a2132d34a => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:07:22.163698 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-baeaf827-6067-42b1-a02b-e7f40d64193f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:22.176155 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-baeaf827-6067-42b1-a02b-e7f40d64193f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:22.176155 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-baeaf827-6067-42b1-a02b-e7f40d64193f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:22.176155 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-baeaf827-6067-42b1-a02b-e7f40d64193f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:22.176155 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-baeaf827-6067-42b1-a02b-e7f40d64193f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:22.177292 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-baeaf827-6067-42b1-a02b-e7f40d64193f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:22.329116 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-baeaf827-6067-42b1-a02b-e7f40d64193f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:22.338643 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-baeaf827-6067-42b1-a02b-e7f40d64193f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:22.340832 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-baeaf827-6067-42b1-a02b-e7f40d64193f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:22.342188 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-baeaf827-6067-42b1-a02b-e7f40d64193f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1723 microversion: 2.20 time: 0.182717 May 31 21:07:22.342856 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 219/458] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:07:22 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:07:22.822434 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-4bf9e948-4df8-40da-853d-09b10f5e1216 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:22.823068 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-4bf9e948-4df8-40da-853d-09b10f5e1216 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] [instance: fb77423f-1f79-41ab-92bc-d77a2132d34a] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:22.830004 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4bf9e948-4df8-40da-853d-09b10f5e1216 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:22.830452 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4bf9e948-4df8-40da-853d-09b10f5e1216 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:22.831241 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4bf9e948-4df8-40da-853d-09b10f5e1216 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:22.831698 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4bf9e948-4df8-40da-853d-09b10f5e1216 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:22.985566 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-4bf9e948-4df8-40da-853d-09b10f5e1216 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f0e0a07754669b7cb9f21502e5906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f722e284eda84b078c1c6935fb728f82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:22.993535 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-4bf9e948-4df8-40da-853d-09b10f5e1216 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] 10.222.0.55 "GET /compute/v2.1/servers/fb77423f-1f79-41ab-92bc-d77a2132d34a" status: 200 len: 1314 microversion: 2.1 time: 0.175012 May 31 21:07:22.994168 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 240/459] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:07:22 2022] GET /compute/v2.1/servers/fb77423f-1f79-41ab-92bc-d77a2132d34a => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:07:23.361812 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-064d16a8-89c3-47ce-b534-5c36360b5b1e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:23.362470 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-064d16a8-89c3-47ce-b534-5c36360b5b1e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:23.369564 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-064d16a8-89c3-47ce-b534-5c36360b5b1e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:23.370048 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-064d16a8-89c3-47ce-b534-5c36360b5b1e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:23.370852 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-064d16a8-89c3-47ce-b534-5c36360b5b1e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:23.371289 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-064d16a8-89c3-47ce-b534-5c36360b5b1e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:23.545083 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-064d16a8-89c3-47ce-b534-5c36360b5b1e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:23.554256 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-064d16a8-89c3-47ce-b534-5c36360b5b1e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:23.555774 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-064d16a8-89c3-47ce-b534-5c36360b5b1e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:23.556979 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-064d16a8-89c3-47ce-b534-5c36360b5b1e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1723 microversion: 2.20 time: 0.199296 May 31 21:07:23.557621 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 220/460] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:07:23 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:07:24.010771 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-9f4e4b55-ca70-4055-a0ec-078eb806373c tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:24.011461 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-9f4e4b55-ca70-4055-a0ec-078eb806373c tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] [instance: fb77423f-1f79-41ab-92bc-d77a2132d34a] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:24.018863 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-9f4e4b55-ca70-4055-a0ec-078eb806373c tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:24.019303 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-9f4e4b55-ca70-4055-a0ec-078eb806373c tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:24.020079 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-9f4e4b55-ca70-4055-a0ec-078eb806373c tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:24.020505 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-9f4e4b55-ca70-4055-a0ec-078eb806373c tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:24.172671 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-9f4e4b55-ca70-4055-a0ec-078eb806373c tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f0e0a07754669b7cb9f21502e5906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f722e284eda84b078c1c6935fb728f82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:24.182120 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-9f4e4b55-ca70-4055-a0ec-078eb806373c tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] 10.222.0.55 "GET /compute/v2.1/servers/fb77423f-1f79-41ab-92bc-d77a2132d34a" status: 200 len: 1314 microversion: 2.1 time: 0.175139 May 31 21:07:24.182708 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 241/461] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:07:24 2022] GET /compute/v2.1/servers/fb77423f-1f79-41ab-92bc-d77a2132d34a => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:07:24.585959 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-f0e9294a-3fbf-459f-b043-45f9f8f672ae tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:24.586582 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-f0e9294a-3fbf-459f-b043-45f9f8f672ae tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:24.595491 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f0e9294a-3fbf-459f-b043-45f9f8f672ae tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:24.596297 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f0e9294a-3fbf-459f-b043-45f9f8f672ae tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:24.597581 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f0e9294a-3fbf-459f-b043-45f9f8f672ae tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:24.598456 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f0e9294a-3fbf-459f-b043-45f9f8f672ae tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:24.994900 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-f0e9294a-3fbf-459f-b043-45f9f8f672ae tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:25.004173 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-f0e9294a-3fbf-459f-b043-45f9f8f672ae tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:25.005686 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-f0e9294a-3fbf-459f-b043-45f9f8f672ae tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:25.006980 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-f0e9294a-3fbf-459f-b043-45f9f8f672ae tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1723 microversion: 2.20 time: 0.425392 May 31 21:07:25.007539 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 221/462] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:07:24 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1723 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:07:25.199810 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-03c44779-84d6-4812-8aa5-1993fe99e6cd tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:25.200435 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-03c44779-84d6-4812-8aa5-1993fe99e6cd tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] [instance: fb77423f-1f79-41ab-92bc-d77a2132d34a] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:25.207009 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-03c44779-84d6-4812-8aa5-1993fe99e6cd tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:25.207450 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-03c44779-84d6-4812-8aa5-1993fe99e6cd tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:25.208490 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-03c44779-84d6-4812-8aa5-1993fe99e6cd tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:25.208930 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-03c44779-84d6-4812-8aa5-1993fe99e6cd tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:25.365947 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-03c44779-84d6-4812-8aa5-1993fe99e6cd tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f0e0a07754669b7cb9f21502e5906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f722e284eda84b078c1c6935fb728f82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:25.375679 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-03c44779-84d6-4812-8aa5-1993fe99e6cd tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] 10.222.0.55 "GET /compute/v2.1/servers/fb77423f-1f79-41ab-92bc-d77a2132d34a" status: 200 len: 1314 microversion: 2.1 time: 0.179048 May 31 21:07:25.376055 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 242/463] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:07:25 2022] GET /compute/v2.1/servers/fb77423f-1f79-41ab-92bc-d77a2132d34a => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:07:26.027106 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-55dfe405-07c7-41c1-9e82-696ab51bc85f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:26.028184 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-55dfe405-07c7-41c1-9e82-696ab51bc85f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:26.035167 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-55dfe405-07c7-41c1-9e82-696ab51bc85f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:26.035624 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-55dfe405-07c7-41c1-9e82-696ab51bc85f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:26.036455 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-55dfe405-07c7-41c1-9e82-696ab51bc85f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:26.036899 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-55dfe405-07c7-41c1-9e82-696ab51bc85f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:26.170162 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-55dfe405-07c7-41c1-9e82-696ab51bc85f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:26.178708 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-55dfe405-07c7-41c1-9e82-696ab51bc85f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:26.180434 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-55dfe405-07c7-41c1-9e82-696ab51bc85f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:26.181624 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-55dfe405-07c7-41c1-9e82-696ab51bc85f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1723 microversion: 2.20 time: 0.159484 May 31 21:07:26.182222 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 222/464] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:07:26 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:07:26.392061 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-b1de858e-15e9-4bf8-8605-c0b31cc79cf3 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:26.392682 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-b1de858e-15e9-4bf8-8605-c0b31cc79cf3 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] [instance: fb77423f-1f79-41ab-92bc-d77a2132d34a] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:26.399223 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b1de858e-15e9-4bf8-8605-c0b31cc79cf3 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:26.399675 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b1de858e-15e9-4bf8-8605-c0b31cc79cf3 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:26.400512 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b1de858e-15e9-4bf8-8605-c0b31cc79cf3 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:26.400887 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b1de858e-15e9-4bf8-8605-c0b31cc79cf3 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:26.546757 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-b1de858e-15e9-4bf8-8605-c0b31cc79cf3 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f0e0a07754669b7cb9f21502e5906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f722e284eda84b078c1c6935fb728f82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:26.554231 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-b1de858e-15e9-4bf8-8605-c0b31cc79cf3 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] 10.222.0.55 "GET /compute/v2.1/servers/fb77423f-1f79-41ab-92bc-d77a2132d34a" status: 200 len: 1314 microversion: 2.1 time: 0.166199 May 31 21:07:26.558432 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 243/465] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:07:26 2022] GET /compute/v2.1/servers/fb77423f-1f79-41ab-92bc-d77a2132d34a => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:07:27.202839 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-d0086177-a47e-4d37-bdca-ff5367f379db tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:27.203863 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-d0086177-a47e-4d37-bdca-ff5367f379db tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:27.214199 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-d0086177-a47e-4d37-bdca-ff5367f379db tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:27.214654 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-d0086177-a47e-4d37-bdca-ff5367f379db tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:27.215817 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-d0086177-a47e-4d37-bdca-ff5367f379db tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:27.216249 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-d0086177-a47e-4d37-bdca-ff5367f379db tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:27.358344 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-d0086177-a47e-4d37-bdca-ff5367f379db tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:27.366862 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-d0086177-a47e-4d37-bdca-ff5367f379db tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:27.368489 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-d0086177-a47e-4d37-bdca-ff5367f379db tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:27.370001 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-d0086177-a47e-4d37-bdca-ff5367f379db tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1723 microversion: 2.20 time: 0.173801 May 31 21:07:27.370619 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 223/466] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:07:27 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:07:27.575098 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-441c4df7-e523-4fa3-b093-ac081b02abdb tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:27.575899 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-441c4df7-e523-4fa3-b093-ac081b02abdb tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] [instance: fb77423f-1f79-41ab-92bc-d77a2132d34a] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:27.583652 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-441c4df7-e523-4fa3-b093-ac081b02abdb tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:27.583975 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-441c4df7-e523-4fa3-b093-ac081b02abdb tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:27.584663 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-441c4df7-e523-4fa3-b093-ac081b02abdb tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:27.585284 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-441c4df7-e523-4fa3-b093-ac081b02abdb tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:27.741787 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-441c4df7-e523-4fa3-b093-ac081b02abdb tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f0e0a07754669b7cb9f21502e5906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f722e284eda84b078c1c6935fb728f82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:27.750757 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-441c4df7-e523-4fa3-b093-ac081b02abdb tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] 10.222.0.55 "GET /compute/v2.1/servers/fb77423f-1f79-41ab-92bc-d77a2132d34a" status: 200 len: 1314 microversion: 2.1 time: 0.181773 May 31 21:07:27.751346 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 244/467] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:07:27 2022] GET /compute/v2.1/servers/fb77423f-1f79-41ab-92bc-d77a2132d34a => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:07:28.389206 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-a5152f37-9905-4b21-9f9d-3774604aaa8a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:28.390078 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-a5152f37-9905-4b21-9f9d-3774604aaa8a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:28.396789 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a5152f37-9905-4b21-9f9d-3774604aaa8a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:28.397234 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a5152f37-9905-4b21-9f9d-3774604aaa8a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:28.398246 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a5152f37-9905-4b21-9f9d-3774604aaa8a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:28.398683 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a5152f37-9905-4b21-9f9d-3774604aaa8a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:28.561357 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-a5152f37-9905-4b21-9f9d-3774604aaa8a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:28.569765 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-a5152f37-9905-4b21-9f9d-3774604aaa8a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:28.571373 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-a5152f37-9905-4b21-9f9d-3774604aaa8a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:28.572567 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-a5152f37-9905-4b21-9f9d-3774604aaa8a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1723 microversion: 2.20 time: 0.188303 May 31 21:07:28.573138 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 224/468] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:07:28 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:07:28.768395 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-e6910a86-93cc-4495-acf5-d132f60c4e91 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:28.768943 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-e6910a86-93cc-4495-acf5-d132f60c4e91 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] [instance: fb77423f-1f79-41ab-92bc-d77a2132d34a] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:28.779249 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e6910a86-93cc-4495-acf5-d132f60c4e91 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:28.779249 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e6910a86-93cc-4495-acf5-d132f60c4e91 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:28.779249 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e6910a86-93cc-4495-acf5-d132f60c4e91 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:28.779249 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e6910a86-93cc-4495-acf5-d132f60c4e91 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:28.930674 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-e6910a86-93cc-4495-acf5-d132f60c4e91 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f0e0a07754669b7cb9f21502e5906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f722e284eda84b078c1c6935fb728f82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:28.939858 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-e6910a86-93cc-4495-acf5-d132f60c4e91 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] 10.222.0.55 "GET /compute/v2.1/servers/fb77423f-1f79-41ab-92bc-d77a2132d34a" status: 200 len: 1497 microversion: 2.1 time: 0.175505 May 31 21:07:28.940466 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 245/469] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:07:28 2022] GET /compute/v2.1/servers/fb77423f-1f79-41ab-92bc-d77a2132d34a => generated 1497 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:07:29.595232 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-fba6ffaf-3c8a-4705-a0ab-5c2050a852c5 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:29.595917 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-fba6ffaf-3c8a-4705-a0ab-5c2050a852c5 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:29.602849 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-fba6ffaf-3c8a-4705-a0ab-5c2050a852c5 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:29.603294 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-fba6ffaf-3c8a-4705-a0ab-5c2050a852c5 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:29.604066 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-fba6ffaf-3c8a-4705-a0ab-5c2050a852c5 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:29.604502 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-fba6ffaf-3c8a-4705-a0ab-5c2050a852c5 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:29.759210 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-fba6ffaf-3c8a-4705-a0ab-5c2050a852c5 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:29.767701 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-fba6ffaf-3c8a-4705-a0ab-5c2050a852c5 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:29.769285 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-fba6ffaf-3c8a-4705-a0ab-5c2050a852c5 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:29.770513 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-fba6ffaf-3c8a-4705-a0ab-5c2050a852c5 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1723 microversion: 2.20 time: 0.179256 May 31 21:07:29.771089 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 225/470] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:07:29 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:07:30.790046 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-5ce06579-2f8c-4cf9-8e40-d6c8f4c27802 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:30.790651 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-5ce06579-2f8c-4cf9-8e40-d6c8f4c27802 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:30.799934 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5ce06579-2f8c-4cf9-8e40-d6c8f4c27802 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:30.799934 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5ce06579-2f8c-4cf9-8e40-d6c8f4c27802 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:30.800628 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5ce06579-2f8c-4cf9-8e40-d6c8f4c27802 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:30.800628 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5ce06579-2f8c-4cf9-8e40-d6c8f4c27802 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:30.948927 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-5ce06579-2f8c-4cf9-8e40-d6c8f4c27802 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:30.958041 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-5ce06579-2f8c-4cf9-8e40-d6c8f4c27802 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:30.959821 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-5ce06579-2f8c-4cf9-8e40-d6c8f4c27802 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:30.961076 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-5ce06579-2f8c-4cf9-8e40-d6c8f4c27802 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1723 microversion: 2.20 time: 0.175480 May 31 21:07:30.961639 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 246/471] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:07:30 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:07:30.995730 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-a870d2dc-2251-4d50-89db-4d5099fd5acb tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:30.996291 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-a870d2dc-2251-4d50-89db-4d5099fd5acb tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:31.003612 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a870d2dc-2251-4d50-89db-4d5099fd5acb tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:31.004095 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a870d2dc-2251-4d50-89db-4d5099fd5acb tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:31.004907 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a870d2dc-2251-4d50-89db-4d5099fd5acb tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:31.005358 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a870d2dc-2251-4d50-89db-4d5099fd5acb tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:31.032064 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-a870d2dc-2251-4d50-89db-4d5099fd5acb tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014/ips" status: 200 len: 145 microversion: 2.1 time: 0.040412 May 31 21:07:31.032717 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 226/472] 10.222.0.55 () {58 vars in 1247 bytes} [Tue May 31 21:07:30 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014/ips => generated 145 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:07:31.982034 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-cfdcde49-69b3-4063-b17f-21e42bd0f46a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:31.982646 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-cfdcde49-69b3-4063-b17f-21e42bd0f46a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:31.989086 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-cfdcde49-69b3-4063-b17f-21e42bd0f46a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:31.989542 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-cfdcde49-69b3-4063-b17f-21e42bd0f46a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:31.990365 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-cfdcde49-69b3-4063-b17f-21e42bd0f46a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:31.990803 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-cfdcde49-69b3-4063-b17f-21e42bd0f46a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:32.143099 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-cfdcde49-69b3-4063-b17f-21e42bd0f46a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:32.157199 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-cfdcde49-69b3-4063-b17f-21e42bd0f46a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:32.158886 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-cfdcde49-69b3-4063-b17f-21e42bd0f46a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:32.160320 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-cfdcde49-69b3-4063-b17f-21e42bd0f46a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1723 microversion: 2.20 time: 0.182307 May 31 21:07:32.161248 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 247/473] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:07:31 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:07:33.179781 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-d3aa6c2d-92b1-47b9-bfad-4118e9b9b137 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:33.180418 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-d3aa6c2d-92b1-47b9-bfad-4118e9b9b137 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:33.183027 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:33.188785 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-d3aa6c2d-92b1-47b9-bfad-4118e9b9b137 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:33.189243 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-d3aa6c2d-92b1-47b9-bfad-4118e9b9b137 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:33.190100 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-d3aa6c2d-92b1-47b9-bfad-4118e9b9b137 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:33.190546 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-d3aa6c2d-92b1-47b9-bfad-4118e9b9b137 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:33.348634 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-d3aa6c2d-92b1-47b9-bfad-4118e9b9b137 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:33.352594 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell1:SELECT=100 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:33.360197 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-d3aa6c2d-92b1-47b9-bfad-4118e9b9b137 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:33.362434 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-d3aa6c2d-92b1-47b9-bfad-4118e9b9b137 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:33.363650 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-d3aa6c2d-92b1-47b9-bfad-4118e9b9b137 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1723 microversion: 2.20 time: 0.188023 May 31 21:07:33.365942 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 227/474] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:07:33 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:07:33.759641 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-5504c80f-f9fc-48f7-954b-ce01022d321a tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:33.760142 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-5504c80f-f9fc-48f7-954b-ce01022d321a tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] [instance: fb77423f-1f79-41ab-92bc-d77a2132d34a] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:33.768073 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5504c80f-f9fc-48f7-954b-ce01022d321a tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:33.769031 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5504c80f-f9fc-48f7-954b-ce01022d321a tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:33.769323 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5504c80f-f9fc-48f7-954b-ce01022d321a tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:33.771267 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5504c80f-f9fc-48f7-954b-ce01022d321a tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:33.808151 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-5504c80f-f9fc-48f7-954b-ce01022d321a tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] [instance: fb77423f-1f79-41ab-92bc-d77a2132d34a] Going to try to terminate instance {{(pid=118184) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 21:07:34.274317 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-5504c80f-f9fc-48f7-954b-ce01022d321a tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] 10.222.0.55 "DELETE /compute/v2.1/servers/fb77423f-1f79-41ab-92bc-d77a2132d34a" status: 204 len: 0 microversion: 2.1 time: 0.517030 May 31 21:07:34.274317 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 248/475] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 31 21:07:33 2022] DELETE /compute/v2.1/servers/fb77423f-1f79-41ab-92bc-d77a2132d34a => generated 0 bytes in 519 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 31 21:07:34.282240 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-4c7ec28e-a3b9-488f-b6a5-1df380f76e19 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:34.282898 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-4c7ec28e-a3b9-488f-b6a5-1df380f76e19 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] [instance: fb77423f-1f79-41ab-92bc-d77a2132d34a] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:34.290382 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4c7ec28e-a3b9-488f-b6a5-1df380f76e19 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:34.290834 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4c7ec28e-a3b9-488f-b6a5-1df380f76e19 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:34.291618 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4c7ec28e-a3b9-488f-b6a5-1df380f76e19 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:34.292059 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4c7ec28e-a3b9-488f-b6a5-1df380f76e19 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:34.396371 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-157eb159-d3d4-4368-a9a1-29eff2370d4c tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:34.397474 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-157eb159-d3d4-4368-a9a1-29eff2370d4c tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:34.406586 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-157eb159-d3d4-4368-a9a1-29eff2370d4c tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:34.407049 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-157eb159-d3d4-4368-a9a1-29eff2370d4c tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:34.407825 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-157eb159-d3d4-4368-a9a1-29eff2370d4c tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:34.408259 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-157eb159-d3d4-4368-a9a1-29eff2370d4c tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:34.478729 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-4c7ec28e-a3b9-488f-b6a5-1df380f76e19 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f0e0a07754669b7cb9f21502e5906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f722e284eda84b078c1c6935fb728f82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:34.486823 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-4c7ec28e-a3b9-488f-b6a5-1df380f76e19 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] 10.222.0.55 "GET /compute/v2.1/servers/fb77423f-1f79-41ab-92bc-d77a2132d34a" status: 200 len: 1503 microversion: 2.1 time: 0.209058 May 31 21:07:34.487507 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 228/476] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:07:34 2022] GET /compute/v2.1/servers/fb77423f-1f79-41ab-92bc-d77a2132d34a => generated 1503 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:07:34.624013 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-157eb159-d3d4-4368-a9a1-29eff2370d4c tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:34.632534 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-157eb159-d3d4-4368-a9a1-29eff2370d4c tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:34.634083 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-157eb159-d3d4-4368-a9a1-29eff2370d4c tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:34.635328 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-157eb159-d3d4-4368-a9a1-29eff2370d4c tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1723 microversion: 2.20 time: 0.245708 May 31 21:07:34.635905 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 249/477] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:07:34 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1723 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:07:34.772823 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-715b2159-6b0c-4597-a69b-1bd2be9dda70 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "60b581fc-08c4-44db-a8da-fde47f2b5b44"}} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:07:34.773926 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-715b2159-6b0c-4597-a69b-1bd2be9dda70 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:34.780461 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-715b2159-6b0c-4597-a69b-1bd2be9dda70 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:34.780921 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-715b2159-6b0c-4597-a69b-1bd2be9dda70 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:34.781704 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-715b2159-6b0c-4597-a69b-1bd2be9dda70 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:34.782169 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-715b2159-6b0c-4597-a69b-1bd2be9dda70 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:35.513639 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-c5b53ff7-b30c-49b7-8d06-609d6d09b422 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:35.514345 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-c5b53ff7-b30c-49b7-8d06-609d6d09b422 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] [instance: fb77423f-1f79-41ab-92bc-d77a2132d34a] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:35.521669 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c5b53ff7-b30c-49b7-8d06-609d6d09b422 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:35.522154 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c5b53ff7-b30c-49b7-8d06-609d6d09b422 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:35.522937 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c5b53ff7-b30c-49b7-8d06-609d6d09b422 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:35.523377 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c5b53ff7-b30c-49b7-8d06-609d6d09b422 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:35.684782 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-c5b53ff7-b30c-49b7-8d06-609d6d09b422 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f0e0a07754669b7cb9f21502e5906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f722e284eda84b078c1c6935fb728f82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:35.698759 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-c5b53ff7-b30c-49b7-8d06-609d6d09b422 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] 10.222.0.55 "GET /compute/v2.1/servers/fb77423f-1f79-41ab-92bc-d77a2132d34a" status: 200 len: 1503 microversion: 2.1 time: 0.189156 May 31 21:07:35.700424 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 250/478] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:07:35 2022] GET /compute/v2.1/servers/fb77423f-1f79-41ab-92bc-d77a2132d34a => generated 1503 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:07:35.715199 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-b735bdd0-4011-41cd-a230-5be5f7e2e997 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:35.716536 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-b735bdd0-4011-41cd-a230-5be5f7e2e997 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:35.722840 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b735bdd0-4011-41cd-a230-5be5f7e2e997 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:35.723288 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b735bdd0-4011-41cd-a230-5be5f7e2e997 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:35.724067 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b735bdd0-4011-41cd-a230-5be5f7e2e997 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:35.724612 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b735bdd0-4011-41cd-a230-5be5f7e2e997 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:35.884638 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-b735bdd0-4011-41cd-a230-5be5f7e2e997 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:35.888662 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:35.894866 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-b735bdd0-4011-41cd-a230-5be5f7e2e997 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:35.895324 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-b735bdd0-4011-41cd-a230-5be5f7e2e997 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:35.896571 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-b735bdd0-4011-41cd-a230-5be5f7e2e997 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1723 microversion: 2.20 time: 0.186446 May 31 21:07:35.897141 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 251/479] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:07:35 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:07:36.725166 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-3f1b6afb-a017-40cd-baf5-71f4680d02e9 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:36.727219 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-3f1b6afb-a017-40cd-baf5-71f4680d02e9 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] [instance: fb77423f-1f79-41ab-92bc-d77a2132d34a] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:36.741464 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-3f1b6afb-a017-40cd-baf5-71f4680d02e9 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:36.742711 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-3f1b6afb-a017-40cd-baf5-71f4680d02e9 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:36.743822 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-3f1b6afb-a017-40cd-baf5-71f4680d02e9 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:36.744636 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-3f1b6afb-a017-40cd-baf5-71f4680d02e9 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:36.990917 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-3f1b6afb-a017-40cd-baf5-71f4680d02e9 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f0e0a07754669b7cb9f21502e5906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f722e284eda84b078c1c6935fb728f82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:36.992649 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-3f1b6afb-a017-40cd-baf5-71f4680d02e9 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] 10.222.0.55 "GET /compute/v2.1/servers/fb77423f-1f79-41ab-92bc-d77a2132d34a" status: 200 len: 1503 microversion: 2.1 time: 0.276343 May 31 21:07:36.993243 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 252/480] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:07:36 2022] GET /compute/v2.1/servers/fb77423f-1f79-41ab-92bc-d77a2132d34a => generated 1503 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:07:36.998564 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-7fbbe640-0ef2-41b5-a07f-62bd4df37ce3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:36.999180 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-7fbbe640-0ef2-41b5-a07f-62bd4df37ce3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:37.005761 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7fbbe640-0ef2-41b5-a07f-62bd4df37ce3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:37.006339 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7fbbe640-0ef2-41b5-a07f-62bd4df37ce3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:37.007411 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7fbbe640-0ef2-41b5-a07f-62bd4df37ce3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:37.007893 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7fbbe640-0ef2-41b5-a07f-62bd4df37ce3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:37.180052 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-7fbbe640-0ef2-41b5-a07f-62bd4df37ce3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:37.189547 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-7fbbe640-0ef2-41b5-a07f-62bd4df37ce3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:37.191111 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-7fbbe640-0ef2-41b5-a07f-62bd4df37ce3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:37.192369 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-7fbbe640-0ef2-41b5-a07f-62bd4df37ce3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1723 microversion: 2.20 time: 0.198179 May 31 21:07:37.192930 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 253/481] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:07:36 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1723 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:07:38.024159 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-adff86dc-91c4-4c45-8923-1c18b1f6dd02 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:38.025489 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-adff86dc-91c4-4c45-8923-1c18b1f6dd02 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] [instance: fb77423f-1f79-41ab-92bc-d77a2132d34a] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:38.038447 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-adff86dc-91c4-4c45-8923-1c18b1f6dd02 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:38.039972 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-adff86dc-91c4-4c45-8923-1c18b1f6dd02 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:38.045409 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-adff86dc-91c4-4c45-8923-1c18b1f6dd02 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:38.045409 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-adff86dc-91c4-4c45-8923-1c18b1f6dd02 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:38.314784 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-adff86dc-91c4-4c45-8923-1c18b1f6dd02 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f0e0a07754669b7cb9f21502e5906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f722e284eda84b078c1c6935fb728f82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:38.329734 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-adff86dc-91c4-4c45-8923-1c18b1f6dd02 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] 10.222.0.55 "GET /compute/v2.1/servers/fb77423f-1f79-41ab-92bc-d77a2132d34a" status: 200 len: 1503 microversion: 2.1 time: 0.312567 May 31 21:07:38.342422 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 254/482] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:07:38 2022] GET /compute/v2.1/servers/fb77423f-1f79-41ab-92bc-d77a2132d34a => generated 1503 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:07:38.348689 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-043589e3-7344-42e7-8d5c-149609eb3c0f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:38.349671 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-043589e3-7344-42e7-8d5c-149609eb3c0f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:38.356728 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-043589e3-7344-42e7-8d5c-149609eb3c0f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:38.357185 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-043589e3-7344-42e7-8d5c-149609eb3c0f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:38.358011 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-043589e3-7344-42e7-8d5c-149609eb3c0f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:38.358486 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-043589e3-7344-42e7-8d5c-149609eb3c0f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:38.644808 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-043589e3-7344-42e7-8d5c-149609eb3c0f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:38.654936 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-043589e3-7344-42e7-8d5c-149609eb3c0f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:38.656673 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-043589e3-7344-42e7-8d5c-149609eb3c0f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:38.658041 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-043589e3-7344-42e7-8d5c-149609eb3c0f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1723 microversion: 2.20 time: 0.313952 May 31 21:07:38.658620 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 255/483] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:07:38 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1723 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:07:39.355535 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-3bf722f8-f598-4d3c-9a30-8d7e5ce23888 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:39.360373 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-3bf722f8-f598-4d3c-9a30-8d7e5ce23888 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] [instance: fb77423f-1f79-41ab-92bc-d77a2132d34a] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:39.367002 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-3bf722f8-f598-4d3c-9a30-8d7e5ce23888 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:39.367543 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-3bf722f8-f598-4d3c-9a30-8d7e5ce23888 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:39.368443 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-3bf722f8-f598-4d3c-9a30-8d7e5ce23888 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:39.369996 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-3bf722f8-f598-4d3c-9a30-8d7e5ce23888 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:39.657115 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-3bf722f8-f598-4d3c-9a30-8d7e5ce23888 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f0e0a07754669b7cb9f21502e5906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f722e284eda84b078c1c6935fb728f82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:39.665862 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-3bf722f8-f598-4d3c-9a30-8d7e5ce23888 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] 10.222.0.55 "GET /compute/v2.1/servers/fb77423f-1f79-41ab-92bc-d77a2132d34a" status: 200 len: 1503 microversion: 2.1 time: 0.314585 May 31 21:07:39.667149 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 256/484] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:07:39 2022] GET /compute/v2.1/servers/fb77423f-1f79-41ab-92bc-d77a2132d34a => generated 1503 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:07:39.689959 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-98499bee-922e-4a00-be0e-68ea73d36059 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:39.692135 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-98499bee-922e-4a00-be0e-68ea73d36059 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:39.705910 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-98499bee-922e-4a00-be0e-68ea73d36059 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:39.706333 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-98499bee-922e-4a00-be0e-68ea73d36059 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:39.707195 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-98499bee-922e-4a00-be0e-68ea73d36059 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:39.707673 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-98499bee-922e-4a00-be0e-68ea73d36059 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:39.899017 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-715b2159-6b0c-4597-a69b-1bd2be9dda70 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "POST /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.130174 May 31 21:07:39.899635 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 229/485] 10.222.0.55 () {60 vars in 1322 bytes} [Tue May 31 21:07:34 2022] POST /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014/os-volume_attachments => generated 194 bytes in 5132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:07:39.908905 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-98499bee-922e-4a00-be0e-68ea73d36059 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:39.917177 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-98499bee-922e-4a00-be0e-68ea73d36059 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:39.919289 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-98499bee-922e-4a00-be0e-68ea73d36059 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:39.920734 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-98499bee-922e-4a00-be0e-68ea73d36059 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1723 microversion: 2.20 time: 0.236523 May 31 21:07:39.921616 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 257/486] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:07:39 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1723 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 21:07:40.754307 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-1fe3713e-738c-4d58-9884-d688ec01eb26 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:40.755016 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-1fe3713e-738c-4d58-9884-d688ec01eb26 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] [instance: fb77423f-1f79-41ab-92bc-d77a2132d34a] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:40.762771 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [req-fc35ec1f-76c5-49ed-a20b-ccdc84290130 req-1bd52ea8-a981-49c9-8350-1c9f20bdad67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb77423f-1f79-41ab-92bc-d77a2132d34a", "name": "network-vif-deleted", "tag": "c8c58b45-478b-4e5e-be1e-25170921559d"}]} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:07:40.768110 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-1fe3713e-738c-4d58-9884-d688ec01eb26 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:40.768919 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-1fe3713e-738c-4d58-9884-d688ec01eb26 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:40.769990 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-1fe3713e-738c-4d58-9884-d688ec01eb26 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:40.770616 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-1fe3713e-738c-4d58-9884-d688ec01eb26 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:40.777263 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-fc35ec1f-76c5-49ed-a20b-ccdc84290130 req-1bd52ea8-a981-49c9-8350-1c9f20bdad67 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:40.779398 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-fc35ec1f-76c5-49ed-a20b-ccdc84290130 req-1bd52ea8-a981-49c9-8350-1c9f20bdad67 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:40.815004 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.compute.server_external_events [req-fc35ec1f-76c5-49ed-a20b-ccdc84290130 req-1bd52ea8-a981-49c9-8350-1c9f20bdad67 service nova] Creating event network-vif-deleted:c8c58b45-478b-4e5e-be1e-25170921559d for instance fb77423f-1f79-41ab-92bc-d77a2132d34a on hv-cinder-83979 May 31 21:07:40.822020 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [req-fc35ec1f-76c5-49ed-a20b-ccdc84290130 req-1bd52ea8-a981-49c9-8350-1c9f20bdad67 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063722 May 31 21:07:40.822608 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 258/487] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:07:40.898575 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-1fe3713e-738c-4d58-9884-d688ec01eb26 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f0e0a07754669b7cb9f21502e5906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f722e284eda84b078c1c6935fb728f82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:40.908808 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-1fe3713e-738c-4d58-9884-d688ec01eb26 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] 10.222.0.55 "GET /compute/v2.1/servers/fb77423f-1f79-41ab-92bc-d77a2132d34a" status: 200 len: 1461 microversion: 2.1 time: 0.160219 May 31 21:07:40.909929 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 230/488] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:07:40 2022] GET /compute/v2.1/servers/fb77423f-1f79-41ab-92bc-d77a2132d34a => generated 1461 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:07:40.951360 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-857a61b6-a395-403a-9a3f-fb8e023666dd tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:40.951360 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-857a61b6-a395-403a-9a3f-fb8e023666dd tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:40.960894 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-857a61b6-a395-403a-9a3f-fb8e023666dd tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:40.961741 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-857a61b6-a395-403a-9a3f-fb8e023666dd tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:40.963158 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-857a61b6-a395-403a-9a3f-fb8e023666dd tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:40.964114 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-857a61b6-a395-403a-9a3f-fb8e023666dd tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:41.286453 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-857a61b6-a395-403a-9a3f-fb8e023666dd tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:41.305741 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-857a61b6-a395-403a-9a3f-fb8e023666dd tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:41.307337 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-857a61b6-a395-403a-9a3f-fb8e023666dd tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:41.308545 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-857a61b6-a395-403a-9a3f-fb8e023666dd tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1723 microversion: 2.20 time: 0.371421 May 31 21:07:41.309735 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 259/489] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:07:40 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1723 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:07:41.927300 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-03917193-f6e6-493e-8a28-dafd4c0820c8 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:41.928069 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-03917193-f6e6-493e-8a28-dafd4c0820c8 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] [instance: fb77423f-1f79-41ab-92bc-d77a2132d34a] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:41.943967 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-03917193-f6e6-493e-8a28-dafd4c0820c8 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:41.944691 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-03917193-f6e6-493e-8a28-dafd4c0820c8 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:41.945738 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-03917193-f6e6-493e-8a28-dafd4c0820c8 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:41.946449 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-03917193-f6e6-493e-8a28-dafd4c0820c8 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:41.986143 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-03917193-f6e6-493e-8a28-dafd4c0820c8 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:41.986736 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-03917193-f6e6-493e-8a28-dafd4c0820c8 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:41.987161 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.objects.instance [None req-03917193-f6e6-493e-8a28-dafd4c0820c8 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lazy-loading 'fault' on Instance uuid fb77423f-1f79-41ab-92bc-d77a2132d34a {{(pid=118185) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 21:07:42.064282 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-03917193-f6e6-493e-8a28-dafd4c0820c8 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f0e0a07754669b7cb9f21502e5906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f722e284eda84b078c1c6935fb728f82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:42.080765 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-03917193-f6e6-493e-8a28-dafd4c0820c8 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] 10.222.0.55 "GET /compute/v2.1/servers/fb77423f-1f79-41ab-92bc-d77a2132d34a" status: 200 len: 1304 microversion: 2.1 time: 0.156697 May 31 21:07:42.082134 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 231/490] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:07:41 2022] GET /compute/v2.1/servers/fb77423f-1f79-41ab-92bc-d77a2132d34a => generated 1304 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:07:42.348746 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-220d2941-eade-4495-94b7-a327c9d14c43 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:42.350303 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-220d2941-eade-4495-94b7-a327c9d14c43 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:42.364782 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-220d2941-eade-4495-94b7-a327c9d14c43 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:42.365595 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-220d2941-eade-4495-94b7-a327c9d14c43 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:42.367232 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-220d2941-eade-4495-94b7-a327c9d14c43 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:42.368153 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-220d2941-eade-4495-94b7-a327c9d14c43 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:42.613347 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-220d2941-eade-4495-94b7-a327c9d14c43 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:42.622400 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-220d2941-eade-4495-94b7-a327c9d14c43 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:42.624216 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-220d2941-eade-4495-94b7-a327c9d14c43 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:42.625533 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-220d2941-eade-4495-94b7-a327c9d14c43 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1723 microversion: 2.20 time: 0.282866 May 31 21:07:42.626125 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 260/491] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:07:42 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1723 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:07:43.108512 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-2ba82484-8526-4e27-acb4-c23f79c3dc95 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:43.109769 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-2ba82484-8526-4e27-acb4-c23f79c3dc95 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] [instance: fb77423f-1f79-41ab-92bc-d77a2132d34a] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:43.117108 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-2ba82484-8526-4e27-acb4-c23f79c3dc95 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:43.117811 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-2ba82484-8526-4e27-acb4-c23f79c3dc95 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:43.119135 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-2ba82484-8526-4e27-acb4-c23f79c3dc95 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:43.119876 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-2ba82484-8526-4e27-acb4-c23f79c3dc95 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:43.146378 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.wsgi [None req-2ba82484-8526-4e27-acb4-c23f79c3dc95 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] HTTP exception thrown: Instance fb77423f-1f79-41ab-92bc-d77a2132d34a could not be found. May 31 21:07:43.150426 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-2ba82484-8526-4e27-acb4-c23f79c3dc95 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Request method failure captured: May 31 21:07:43.150426 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: request: GET /compute/v2.1/servers/fb77423f-1f79-41ab-92bc-d77a2132d34a HTTP/1.1 May 31 21:07:43.150426 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Accept: application/json May 31 21:07:43.150426 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Accept-Encoding: identity May 31 21:07:43.150426 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Connection: close May 31 21:07:43.150426 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Content-Length: 0 May 31 21:07:43.150426 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Content-Type: application/json May 31 21:07:43.150426 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Host: 10.222.0.55 May 31 21:07:43.150426 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Openstack-System-Scope: None May 31 21:07:43.150426 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: User-Agent: python-urllib3/1.26.9 May 31 21:07:43.150426 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Auth-Token: gAAAAABiloN0QMqEVRq10e6FXQfKkePhMF8zqQGl2fGTUSk0Jq8IPugPP3DrB2LoHhws7gRSuGYmZredum7IdgK249M0-3R1m-hUirkuHzoERTaPHOLZ17HK7yKoH1z2lVm-Tucd1Y9lPzGQfySAAYt4-zQTY8DiMUXOVy2imzHVrMWH4RI9HIU May 31 21:07:43.150426 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Domain-Id: None May 31 21:07:43.150426 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Domain-Name: None May 31 21:07:43.150426 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Identity-Status: Confirmed May 31 21:07:43.150426 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Is-Admin-Project: True May 31 21:07:43.150426 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Domain-Id: default May 31 21:07:43.150426 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Domain-Name: Default May 31 21:07:43.150426 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Id: f722e284eda84b078c1c6935fb728f82 May 31 21:07:43.150426 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Name: tempest-VolumesActionsTest-897468629 May 31 21:07:43.150426 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Role: member,reader May 31 21:07:43.150426 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Roles: member,reader May 31 21:07:43.152093 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/f722e284eda84b078c1c6935fb728f82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f722e284eda84b078c1c6935fb728f82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_f722e284eda84b078c1c6935fb728f82", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f722e284eda84b078c1c6935fb728f82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] May 31 21:07:43.152093 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant: tempest-VolumesActionsTest-897468629 May 31 21:07:43.152093 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant-Id: f722e284eda84b078c1c6935fb728f82 May 31 21:07:43.152093 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant-Name: tempest-VolumesActionsTest-897468629 May 31 21:07:43.152093 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User: tempest-VolumesActionsTest-897468629-project May 31 21:07:43.152093 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Domain-Id: default May 31 21:07:43.152093 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Domain-Name: Default May 31 21:07:43.152093 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Id: 757f0e0a07754669b7cb9f21502e5906 May 31 21:07:43.152093 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Name: tempest-VolumesActionsTest-897468629-project May 31 21:07:43.152093 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: method: > May 31 21:07:43.152093 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: exception: Instance fb77423f-1f79-41ab-92bc-d77a2132d34a could not be found. May 31 21:07:43.152093 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: action_args: {'id': 'fb77423f-1f79-41ab-92bc-d77a2132d34a'} May 31 21:07:43.153584 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 21:07:43.153584 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:07:43.153584 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 21:07:43.153584 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 21:07:43.153584 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 21:07:43.153584 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 21:07:43.153584 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 21:07:43.153584 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 21:07:43.153584 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 21:07:43.153584 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 21:07:43.153584 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb77423f-1f79-41ab-92bc-d77a2132d34a could not be found. May 31 21:07:43.153584 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:07:43.153584 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:07:43.153584 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:07:43.153584 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:07:43.153584 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:07:43.153584 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:07:43.153584 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 21:07:43.153584 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 21:07:43.153584 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 21:07:43.155201 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 21:07:43.155201 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 21:07:43.155201 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 21:07:43.155201 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 21:07:43.155201 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 21:07:43.155201 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 21:07:43.155201 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 21:07:43.155201 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb77423f-1f79-41ab-92bc-d77a2132d34a could not be found. May 31 21:07:43.155201 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:07:43.155201 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:07:43.155201 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:07:43.155201 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:07:43.155201 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:07:43.155201 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:07:43.155201 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 21:07:43.155201 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 21:07:43.155201 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb77423f-1f79-41ab-92bc-d77a2132d34a could not be found. May 31 21:07:43.155201 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:07:43.157430 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-2ba82484-8526-4e27-acb4-c23f79c3dc95 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Returning 404 to user: Instance fb77423f-1f79-41ab-92bc-d77a2132d34a could not be found. {{(pid=118185) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 21:07:43.158533 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-2ba82484-8526-4e27-acb4-c23f79c3dc95 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] 10.222.0.55 "GET /compute/v2.1/servers/fb77423f-1f79-41ab-92bc-d77a2132d34a" status: 404 len: 111 microversion: 2.1 time: 0.054982 May 31 21:07:43.159222 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 232/492] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:07:43 2022] GET /compute/v2.1/servers/fb77423f-1f79-41ab-92bc-d77a2132d34a => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 21:07:43.306976 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-73d59ec4-a438-48a6-8b73-6aadc5c1a240 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1708206483", "imageRef": "21b89996-9e87-489d-8891-305f6c3d905a", "flavorRef": "452", "networks": [{"uuid": "31d0d2cb-3b54-4c55-b456-24ad3c7e1be7"}]}} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:07:43.418501 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.network.neutron [None req-73d59ec4-a438-48a6-8b73-6aadc5c1a240 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] validate_networks() for [('31d0d2cb-3b54-4c55-b456-24ad3c7e1be7', None, None, None, None, None)] {{(pid=118184) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 21:07:43.648275 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-4a155779-625a-4d18-b0d5-2b85d0611039 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:43.649366 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-4a155779-625a-4d18-b0d5-2b85d0611039 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:43.657695 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4a155779-625a-4d18-b0d5-2b85d0611039 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:43.658423 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4a155779-625a-4d18-b0d5-2b85d0611039 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:43.659418 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4a155779-625a-4d18-b0d5-2b85d0611039 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:43.660030 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4a155779-625a-4d18-b0d5-2b85d0611039 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:44.106946 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-4a155779-625a-4d18-b0d5-2b85d0611039 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:44.118550 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-4a155779-625a-4d18-b0d5-2b85d0611039 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:44.121214 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-4a155779-625a-4d18-b0d5-2b85d0611039 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:44.123458 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-4a155779-625a-4d18-b0d5-2b85d0611039 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1744 microversion: 2.20 time: 0.482114 May 31 21:07:44.124348 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 233/493] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:07:43 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1744 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:07:44.302216 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.virt.hardware [None req-73d59ec4-a438-48a6-8b73-6aadc5c1a240 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Flavor limits 0:0:0 {{(pid=118184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 21:07:44.303477 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.virt.hardware [None req-73d59ec4-a438-48a6-8b73-6aadc5c1a240 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Image limits 0:0:0 {{(pid=118184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 21:07:44.303950 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.virt.hardware [None req-73d59ec4-a438-48a6-8b73-6aadc5c1a240 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Flavor pref 0:0:0 {{(pid=118184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 21:07:44.304625 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.virt.hardware [None req-73d59ec4-a438-48a6-8b73-6aadc5c1a240 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Image pref 0:0:0 {{(pid=118184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 21:07:44.305067 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.virt.hardware [None req-73d59ec4-a438-48a6-8b73-6aadc5c1a240 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 21:07:44.316017 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-73d59ec4-a438-48a6-8b73-6aadc5c1a240 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:44.316458 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-73d59ec4-a438-48a6-8b73-6aadc5c1a240 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:44.317250 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-73d59ec4-a438-48a6-8b73-6aadc5c1a240 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:44.317675 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-73d59ec4-a438-48a6-8b73-6aadc5c1a240 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:44.336816 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.quota [None req-73d59ec4-a438-48a6-8b73-6aadc5c1a240 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Getting quotas for project f722e284eda84b078c1c6935fb728f82. Resources: {'ram', 'cores', 'instances'} {{(pid=118184) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 21:07:44.341851 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.quota [None req-73d59ec4-a438-48a6-8b73-6aadc5c1a240 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Getting quotas for user 757f0e0a07754669b7cb9f21502e5906 and project f722e284eda84b078c1c6935fb728f82. Resources: {'ram', 'cores', 'instances'} {{(pid=118184) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 21:07:44.354410 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-73d59ec4-a438-48a6-8b73-6aadc5c1a240 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Going to run 1 instances... {{(pid=118184) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 21:07:44.357279 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-73d59ec4-a438-48a6-8b73-6aadc5c1a240 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] [instance: c59245fe-2b3a-4cea-85db-b7b8e0aea06f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='21b89996-9e87-489d-8891-305f6c3d905a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118184) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 21:07:44.486296 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-73d59ec4-a438-48a6-8b73-6aadc5c1a240 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.187365 May 31 21:07:44.487666 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 261/494] 10.222.0.55 () {60 vars in 1146 bytes} [Tue May 31 21:07:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1190 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 31 21:07:44.501033 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-27be1fa9-665b-4a73-8d91-dc95f70bacdc tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:44.501871 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-27be1fa9-665b-4a73-8d91-dc95f70bacdc tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] [instance: c59245fe-2b3a-4cea-85db-b7b8e0aea06f] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:44.562132 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-27be1fa9-665b-4a73-8d91-dc95f70bacdc tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f0e0a07754669b7cb9f21502e5906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f722e284eda84b078c1c6935fb728f82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:44.574620 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-27be1fa9-665b-4a73-8d91-dc95f70bacdc tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] 10.222.0.55 "GET /compute/v2.1/servers/c59245fe-2b3a-4cea-85db-b7b8e0aea06f" status: 200 len: 1214 microversion: 2.1 time: 0.073306 May 31 21:07:44.574620 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 234/495] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:07:44 2022] GET /compute/v2.1/servers/c59245fe-2b3a-4cea-85db-b7b8e0aea06f => generated 1214 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:07:45.146511 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-648413d3-bdca-4b3d-98dc-2b6011c30467 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:45.147358 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-648413d3-bdca-4b3d-98dc-2b6011c30467 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:45.155328 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-648413d3-bdca-4b3d-98dc-2b6011c30467 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:45.155913 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-648413d3-bdca-4b3d-98dc-2b6011c30467 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:45.156827 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-648413d3-bdca-4b3d-98dc-2b6011c30467 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:45.157346 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-648413d3-bdca-4b3d-98dc-2b6011c30467 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:45.389343 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-648413d3-bdca-4b3d-98dc-2b6011c30467 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:45.402320 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-648413d3-bdca-4b3d-98dc-2b6011c30467 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:45.405246 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-648413d3-bdca-4b3d-98dc-2b6011c30467 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:45.406558 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-648413d3-bdca-4b3d-98dc-2b6011c30467 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1744 microversion: 2.20 time: 0.265942 May 31 21:07:45.407198 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 262/496] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:07:45 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1744 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:07:45.590949 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-69fbb393-7deb-49cb-819c-a1901b58e8b9 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:45.592091 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-69fbb393-7deb-49cb-819c-a1901b58e8b9 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] [instance: c59245fe-2b3a-4cea-85db-b7b8e0aea06f] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:45.599310 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-69fbb393-7deb-49cb-819c-a1901b58e8b9 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:45.600143 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-69fbb393-7deb-49cb-819c-a1901b58e8b9 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:45.601216 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-69fbb393-7deb-49cb-819c-a1901b58e8b9 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:45.602370 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-69fbb393-7deb-49cb-819c-a1901b58e8b9 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:45.726544 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-69fbb393-7deb-49cb-819c-a1901b58e8b9 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f0e0a07754669b7cb9f21502e5906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f722e284eda84b078c1c6935fb728f82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:45.735618 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-69fbb393-7deb-49cb-819c-a1901b58e8b9 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] 10.222.0.55 "GET /compute/v2.1/servers/c59245fe-2b3a-4cea-85db-b7b8e0aea06f" status: 200 len: 1218 microversion: 2.1 time: 0.152400 May 31 21:07:45.736194 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 235/497] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:07:45 2022] GET /compute/v2.1/servers/c59245fe-2b3a-4cea-85db-b7b8e0aea06f => generated 1218 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:07:45.860192 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [req-2b4e6e8a-919d-4a1e-aaa4-ffd0f6a849a0 req-1eb11b50-0523-43ec-a51b-6ceb79d9ed0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a123764b-4693-41b1-bad8-a1a63cc951cd", "name": "network-vif-plugged", "status": "completed", "tag": "cc0edf95-fc02-451a-b38f-075bee275ed6"}]} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:07:45.878170 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-2b4e6e8a-919d-4a1e-aaa4-ffd0f6a849a0 req-1eb11b50-0523-43ec-a51b-6ceb79d9ed0a service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:45.879669 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-2b4e6e8a-919d-4a1e-aaa4-ffd0f6a849a0 req-1eb11b50-0523-43ec-a51b-6ceb79d9ed0a service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:45.906208 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.compute.server_external_events [req-2b4e6e8a-919d-4a1e-aaa4-ffd0f6a849a0 req-1eb11b50-0523-43ec-a51b-6ceb79d9ed0a service nova] Creating event network-vif-plugged:cc0edf95-fc02-451a-b38f-075bee275ed6 for instance a123764b-4693-41b1-bad8-a1a63cc951cd on hv-cinder-83979 May 31 21:07:45.917803 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [req-2b4e6e8a-919d-4a1e-aaa4-ffd0f6a849a0 req-1eb11b50-0523-43ec-a51b-6ceb79d9ed0a service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065592 May 31 21:07:45.920066 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 263/498] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:07:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 21:07:46.441083 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-e156a717-f87f-4f80-90b0-c9382649ddbb tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:46.441083 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-e156a717-f87f-4f80-90b0-c9382649ddbb tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:46.444595 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e156a717-f87f-4f80-90b0-c9382649ddbb tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:46.449675 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e156a717-f87f-4f80-90b0-c9382649ddbb tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:46.449675 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e156a717-f87f-4f80-90b0-c9382649ddbb tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:46.449675 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e156a717-f87f-4f80-90b0-c9382649ddbb tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:46.638551 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-e156a717-f87f-4f80-90b0-c9382649ddbb tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:46.653195 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-e156a717-f87f-4f80-90b0-c9382649ddbb tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:46.655650 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-e156a717-f87f-4f80-90b0-c9382649ddbb tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:46.657079 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-e156a717-f87f-4f80-90b0-c9382649ddbb tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1744 microversion: 2.20 time: 0.223903 May 31 21:07:46.657761 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 236/499] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:07:46 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1744 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:07:46.761162 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-ab802db7-3b20-4f24-bcd8-45280b134d39 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:46.761869 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-ab802db7-3b20-4f24-bcd8-45280b134d39 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] [instance: c59245fe-2b3a-4cea-85db-b7b8e0aea06f] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:46.770396 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ab802db7-3b20-4f24-bcd8-45280b134d39 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:46.770776 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ab802db7-3b20-4f24-bcd8-45280b134d39 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:46.771578 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ab802db7-3b20-4f24-bcd8-45280b134d39 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:46.772019 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ab802db7-3b20-4f24-bcd8-45280b134d39 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:46.844488 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-ab802db7-3b20-4f24-bcd8-45280b134d39 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f0e0a07754669b7cb9f21502e5906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f722e284eda84b078c1c6935fb728f82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:46.852225 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-ab802db7-3b20-4f24-bcd8-45280b134d39 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] 10.222.0.55 "GET /compute/v2.1/servers/c59245fe-2b3a-4cea-85db-b7b8e0aea06f" status: 200 len: 1266 microversion: 2.1 time: 0.096094 May 31 21:07:46.852846 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 264/500] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:07:46 2022] GET /compute/v2.1/servers/c59245fe-2b3a-4cea-85db-b7b8e0aea06f => generated 1266 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:07:47.676763 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-6d7d6569-582e-4c48-b2ef-aeca111db5b4 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:47.678146 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-6d7d6569-582e-4c48-b2ef-aeca111db5b4 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:47.687495 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-6d7d6569-582e-4c48-b2ef-aeca111db5b4 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:47.689514 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-6d7d6569-582e-4c48-b2ef-aeca111db5b4 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:47.698029 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-6d7d6569-582e-4c48-b2ef-aeca111db5b4 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:47.698760 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-6d7d6569-582e-4c48-b2ef-aeca111db5b4 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:47.874327 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-1c7a56f5-744e-4b2b-8107-1c692823ad72 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:47.874957 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-1c7a56f5-744e-4b2b-8107-1c692823ad72 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] [instance: c59245fe-2b3a-4cea-85db-b7b8e0aea06f] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:47.893847 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-1c7a56f5-744e-4b2b-8107-1c692823ad72 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:47.894474 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-1c7a56f5-744e-4b2b-8107-1c692823ad72 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:47.895329 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-1c7a56f5-744e-4b2b-8107-1c692823ad72 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:47.895764 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-1c7a56f5-744e-4b2b-8107-1c692823ad72 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:47.962177 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-6d7d6569-582e-4c48-b2ef-aeca111db5b4 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:47.972016 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-6d7d6569-582e-4c48-b2ef-aeca111db5b4 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:47.973993 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-6d7d6569-582e-4c48-b2ef-aeca111db5b4 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:47.975404 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-6d7d6569-582e-4c48-b2ef-aeca111db5b4 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1744 microversion: 2.20 time: 0.302660 May 31 21:07:47.976163 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 237/501] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:07:47 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1744 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:07:48.017939 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-1c7a56f5-744e-4b2b-8107-1c692823ad72 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f0e0a07754669b7cb9f21502e5906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f722e284eda84b078c1c6935fb728f82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:48.031084 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-1c7a56f5-744e-4b2b-8107-1c692823ad72 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] 10.222.0.55 "GET /compute/v2.1/servers/c59245fe-2b3a-4cea-85db-b7b8e0aea06f" status: 200 len: 1274 microversion: 2.1 time: 0.161153 May 31 21:07:48.031956 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 265/502] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:07:47 2022] GET /compute/v2.1/servers/c59245fe-2b3a-4cea-85db-b7b8e0aea06f => generated 1274 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:07:48.764718 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-a851f604-d7cb-4ce1-8a11-eef1e3325049 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:07:48.775552 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a851f604-d7cb-4ce1-8a11-eef1e3325049 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:48.776992 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a851f604-d7cb-4ce1-8a11-eef1e3325049 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:48.908554 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-a851f604-d7cb-4ce1-8a11-eef1e3325049 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Going to try to stop instance {{(pid=118185) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 31 21:07:49.001236 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-64123a88-e913-4f0c-9131-7e12241f2f36 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:49.003181 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-64123a88-e913-4f0c-9131-7e12241f2f36 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:49.014564 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-64123a88-e913-4f0c-9131-7e12241f2f36 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:49.015138 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-64123a88-e913-4f0c-9131-7e12241f2f36 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:49.016106 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-64123a88-e913-4f0c-9131-7e12241f2f36 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:49.017589 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-64123a88-e913-4f0c-9131-7e12241f2f36 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:49.214039 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-a851f604-d7cb-4ce1-8a11-eef1e3325049 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "POST /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014/action" status: 202 len: 0 microversion: 2.1 time: 0.454103 May 31 21:07:49.217195 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 238/503] 10.222.0.55 () {60 vars in 1277 bytes} [Tue May 31 21:07:48 2022] POST /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014/action => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 21:07:49.241814 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-ada00295-e160-41ac-8790-39f6714b8ef5 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:49.243026 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-ada00295-e160-41ac-8790-39f6714b8ef5 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] [instance: c59245fe-2b3a-4cea-85db-b7b8e0aea06f] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:49.268525 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ada00295-e160-41ac-8790-39f6714b8ef5 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:49.270464 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ada00295-e160-41ac-8790-39f6714b8ef5 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:49.271488 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ada00295-e160-41ac-8790-39f6714b8ef5 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:49.273369 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ada00295-e160-41ac-8790-39f6714b8ef5 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:49.299483 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-64123a88-e913-4f0c-9131-7e12241f2f36 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:49.337190 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-64123a88-e913-4f0c-9131-7e12241f2f36 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:49.341275 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-64123a88-e913-4f0c-9131-7e12241f2f36 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:49.342910 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-64123a88-e913-4f0c-9131-7e12241f2f36 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1744 microversion: 2.20 time: 0.346120 May 31 21:07:49.344012 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 266/504] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:07:48 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1744 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 21:07:49.368468 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-8f53ca30-2798-4552-a05b-b25c76375f4e tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:49.372543 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-8f53ca30-2798-4552-a05b-b25c76375f4e tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:49.380702 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-8f53ca30-2798-4552-a05b-b25c76375f4e tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:49.381980 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-8f53ca30-2798-4552-a05b-b25c76375f4e tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:49.383152 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-8f53ca30-2798-4552-a05b-b25c76375f4e tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:49.383319 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-ada00295-e160-41ac-8790-39f6714b8ef5 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f0e0a07754669b7cb9f21502e5906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f722e284eda84b078c1c6935fb728f82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:49.383915 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-8f53ca30-2798-4552-a05b-b25c76375f4e tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:49.397182 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-ada00295-e160-41ac-8790-39f6714b8ef5 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] 10.222.0.55 "GET /compute/v2.1/servers/c59245fe-2b3a-4cea-85db-b7b8e0aea06f" status: 200 len: 1272 microversion: 2.1 time: 0.178127 May 31 21:07:49.400307 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 239/505] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:07:49 2022] GET /compute/v2.1/servers/c59245fe-2b3a-4cea-85db-b7b8e0aea06f => generated 1272 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:07:49.681919 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-8f53ca30-2798-4552-a05b-b25c76375f4e tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:49.711668 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-8f53ca30-2798-4552-a05b-b25c76375f4e tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1723 microversion: 2.1 time: 0.335164 May 31 21:07:49.711668 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 267/506] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:07:49 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1723 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:07:50.366611 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-9f306daf-6536-42db-8dde-60bc7c2a0f9b tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:50.368087 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-9f306daf-6536-42db-8dde-60bc7c2a0f9b tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:50.400541 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9f306daf-6536-42db-8dde-60bc7c2a0f9b tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:50.401012 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9f306daf-6536-42db-8dde-60bc7c2a0f9b tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:50.401983 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9f306daf-6536-42db-8dde-60bc7c2a0f9b tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:50.402398 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9f306daf-6536-42db-8dde-60bc7c2a0f9b tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:50.421215 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-ac00af8f-8a2c-45b7-846b-1a516c390b2e tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:50.421215 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-ac00af8f-8a2c-45b7-846b-1a516c390b2e tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] [instance: c59245fe-2b3a-4cea-85db-b7b8e0aea06f] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:50.422429 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:50.444926 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ac00af8f-8a2c-45b7-846b-1a516c390b2e tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:50.445391 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ac00af8f-8a2c-45b7-846b-1a516c390b2e tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:50.455636 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ac00af8f-8a2c-45b7-846b-1a516c390b2e tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:50.455636 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ac00af8f-8a2c-45b7-846b-1a516c390b2e tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:50.858850 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-9f306daf-6536-42db-8dde-60bc7c2a0f9b tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:50.879136 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-9f306daf-6536-42db-8dde-60bc7c2a0f9b tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:50.881125 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-9f306daf-6536-42db-8dde-60bc7c2a0f9b tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:50.886392 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-9f306daf-6536-42db-8dde-60bc7c2a0f9b tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1739 microversion: 2.20 time: 0.524515 May 31 21:07:50.887617 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 240/507] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:07:50 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1739 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:07:50.892590 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-2c85bc35-3e5d-4be8-bc56-9762b2fb8131 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:50.898698 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-2c85bc35-3e5d-4be8-bc56-9762b2fb8131 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:50.921314 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-2c85bc35-3e5d-4be8-bc56-9762b2fb8131 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:50.922167 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-2c85bc35-3e5d-4be8-bc56-9762b2fb8131 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:50.923345 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-2c85bc35-3e5d-4be8-bc56-9762b2fb8131 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:50.924005 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-2c85bc35-3e5d-4be8-bc56-9762b2fb8131 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:51.477143 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-ac00af8f-8a2c-45b7-846b-1a516c390b2e tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f0e0a07754669b7cb9f21502e5906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f722e284eda84b078c1c6935fb728f82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:51.491653 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-ac00af8f-8a2c-45b7-846b-1a516c390b2e tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] 10.222.0.55 "GET /compute/v2.1/servers/c59245fe-2b3a-4cea-85db-b7b8e0aea06f" status: 200 len: 1314 microversion: 2.1 time: 1.077201 May 31 21:07:51.492233 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 268/508] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:07:50 2022] GET /compute/v2.1/servers/c59245fe-2b3a-4cea-85db-b7b8e0aea06f => generated 1314 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:07:51.698205 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-2c85bc35-3e5d-4be8-bc56-9762b2fb8131 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:51.712644 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-2c85bc35-3e5d-4be8-bc56-9762b2fb8131 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1723 microversion: 2.1 time: 0.823558 May 31 21:07:51.718250 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 241/509] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:07:50 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1723 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:07:51.986183 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-a9b3705b-4b02-416c-9d3c-6a792485b535 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:51.986183 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-a9b3705b-4b02-416c-9d3c-6a792485b535 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:51.986183 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a9b3705b-4b02-416c-9d3c-6a792485b535 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:51.986183 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a9b3705b-4b02-416c-9d3c-6a792485b535 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:51.987748 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a9b3705b-4b02-416c-9d3c-6a792485b535 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:51.987748 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a9b3705b-4b02-416c-9d3c-6a792485b535 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:52.274206 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-a9b3705b-4b02-416c-9d3c-6a792485b535 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:52.286337 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-a9b3705b-4b02-416c-9d3c-6a792485b535 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:52.289408 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-a9b3705b-4b02-416c-9d3c-6a792485b535 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:52.305803 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-a9b3705b-4b02-416c-9d3c-6a792485b535 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1739 microversion: 2.20 time: 0.402583 May 31 21:07:52.306742 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 269/510] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:07:51 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1739 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:07:52.323452 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [req-6ac4989d-7ba6-4c28-9651-ba8b2f0fd662 req-2cfbcdde-c746-4389-a6e4-6b5a509aca52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c59245fe-2b3a-4cea-85db-b7b8e0aea06f", "tag": "6ff2f985-0e66-4260-9039-36545ea47a85"}]} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:07:52.337804 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-6ac4989d-7ba6-4c28-9651-ba8b2f0fd662 req-2cfbcdde-c746-4389-a6e4-6b5a509aca52 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:52.370253 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-6ac4989d-7ba6-4c28-9651-ba8b2f0fd662 req-2cfbcdde-c746-4389-a6e4-6b5a509aca52 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:52.398027 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.compute.server_external_events [req-6ac4989d-7ba6-4c28-9651-ba8b2f0fd662 req-2cfbcdde-c746-4389-a6e4-6b5a509aca52 service nova] Creating event network-changed:6ff2f985-0e66-4260-9039-36545ea47a85 for instance c59245fe-2b3a-4cea-85db-b7b8e0aea06f on hv-cinder-83979 May 31 21:07:52.405808 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [req-6ac4989d-7ba6-4c28-9651-ba8b2f0fd662 req-2cfbcdde-c746-4389-a6e4-6b5a509aca52 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086235 May 31 21:07:52.450833 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 242/511] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:07:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:07:52.554348 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-0d6d9907-0246-4917-b60b-4efa47d9ad67 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:52.554348 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-0d6d9907-0246-4917-b60b-4efa47d9ad67 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] [instance: c59245fe-2b3a-4cea-85db-b7b8e0aea06f] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:52.554348 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-0d6d9907-0246-4917-b60b-4efa47d9ad67 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:52.554348 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-0d6d9907-0246-4917-b60b-4efa47d9ad67 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:52.555255 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-0d6d9907-0246-4917-b60b-4efa47d9ad67 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:52.555255 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-0d6d9907-0246-4917-b60b-4efa47d9ad67 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:52.599875 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell1:SELECT=100 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:52.737534 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-322cacb3-893e-4842-9637-05ddd3422c04 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:52.739452 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-322cacb3-893e-4842-9637-05ddd3422c04 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:52.770727 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-322cacb3-893e-4842-9637-05ddd3422c04 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:52.771478 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-322cacb3-893e-4842-9637-05ddd3422c04 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:52.773246 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-322cacb3-893e-4842-9637-05ddd3422c04 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:52.775441 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-322cacb3-893e-4842-9637-05ddd3422c04 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:52.785295 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-0d6d9907-0246-4917-b60b-4efa47d9ad67 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f0e0a07754669b7cb9f21502e5906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f722e284eda84b078c1c6935fb728f82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:52.799553 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-0d6d9907-0246-4917-b60b-4efa47d9ad67 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] 10.222.0.55 "GET /compute/v2.1/servers/c59245fe-2b3a-4cea-85db-b7b8e0aea06f" status: 200 len: 1314 microversion: 2.1 time: 0.284436 May 31 21:07:52.800525 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 270/512] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:07:52 2022] GET /compute/v2.1/servers/c59245fe-2b3a-4cea-85db-b7b8e0aea06f => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:07:53.026630 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-322cacb3-893e-4842-9637-05ddd3422c04 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:53.041376 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-322cacb3-893e-4842-9637-05ddd3422c04 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1723 microversion: 2.1 time: 0.310969 May 31 21:07:53.041991 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 243/513] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:07:52 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1723 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:07:53.328662 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-3353fc69-49a4-428d-bfe0-2dea08f9b305 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:53.329701 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-3353fc69-49a4-428d-bfe0-2dea08f9b305 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:53.350025 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-3353fc69-49a4-428d-bfe0-2dea08f9b305 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:53.356604 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-3353fc69-49a4-428d-bfe0-2dea08f9b305 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:53.366138 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-3353fc69-49a4-428d-bfe0-2dea08f9b305 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:53.367189 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-3353fc69-49a4-428d-bfe0-2dea08f9b305 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:53.810575 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-3353fc69-49a4-428d-bfe0-2dea08f9b305 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:53.818683 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-192ecea9-0c1e-4797-87c6-500f0edb273e tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:53.819938 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-192ecea9-0c1e-4797-87c6-500f0edb273e tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] [instance: c59245fe-2b3a-4cea-85db-b7b8e0aea06f] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:53.823062 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-3353fc69-49a4-428d-bfe0-2dea08f9b305 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:53.825666 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-3353fc69-49a4-428d-bfe0-2dea08f9b305 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:53.829049 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-192ecea9-0c1e-4797-87c6-500f0edb273e tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:53.829675 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-192ecea9-0c1e-4797-87c6-500f0edb273e tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:53.829823 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-3353fc69-49a4-428d-bfe0-2dea08f9b305 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1739 microversion: 2.20 time: 0.508493 May 31 21:07:53.834332 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 271/514] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:07:53 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1739 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:07:53.842045 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-192ecea9-0c1e-4797-87c6-500f0edb273e tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:53.842810 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-192ecea9-0c1e-4797-87c6-500f0edb273e tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:53.848046 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:54.060772 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-eacf3f45-e52c-439c-9e9d-6082eb3d58ec tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:54.061436 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-eacf3f45-e52c-439c-9e9d-6082eb3d58ec tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:54.068511 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-eacf3f45-e52c-439c-9e9d-6082eb3d58ec tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:54.069013 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-eacf3f45-e52c-439c-9e9d-6082eb3d58ec tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:54.070084 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-eacf3f45-e52c-439c-9e9d-6082eb3d58ec tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:54.070795 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-eacf3f45-e52c-439c-9e9d-6082eb3d58ec tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:54.260213 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-192ecea9-0c1e-4797-87c6-500f0edb273e tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f0e0a07754669b7cb9f21502e5906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f722e284eda84b078c1c6935fb728f82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:54.281963 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-192ecea9-0c1e-4797-87c6-500f0edb273e tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] 10.222.0.55 "GET /compute/v2.1/servers/c59245fe-2b3a-4cea-85db-b7b8e0aea06f" status: 200 len: 1314 microversion: 2.1 time: 0.467722 May 31 21:07:54.283313 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 244/515] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:07:53 2022] GET /compute/v2.1/servers/c59245fe-2b3a-4cea-85db-b7b8e0aea06f => generated 1314 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:07:54.324941 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell0:SELECT=2 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:54.349158 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell0:SELECT=6 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:54.494489 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-eacf3f45-e52c-439c-9e9d-6082eb3d58ec tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:54.504453 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-eacf3f45-e52c-439c-9e9d-6082eb3d58ec tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1723 microversion: 2.1 time: 0.448767 May 31 21:07:54.515684 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 272/516] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:07:54 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1723 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:07:54.852031 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-53613ba9-8748-4d77-bda9-4bf1da963ff5 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:54.854881 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-53613ba9-8748-4d77-bda9-4bf1da963ff5 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:54.878930 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell0:SELECT=2 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:54.881614 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-53613ba9-8748-4d77-bda9-4bf1da963ff5 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:54.884406 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-53613ba9-8748-4d77-bda9-4bf1da963ff5 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:54.894785 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-53613ba9-8748-4d77-bda9-4bf1da963ff5 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:54.894785 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-53613ba9-8748-4d77-bda9-4bf1da963ff5 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:55.133343 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-53613ba9-8748-4d77-bda9-4bf1da963ff5 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:55.145174 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-53613ba9-8748-4d77-bda9-4bf1da963ff5 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:55.147506 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-53613ba9-8748-4d77-bda9-4bf1da963ff5 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:55.148867 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-53613ba9-8748-4d77-bda9-4bf1da963ff5 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1739 microversion: 2.20 time: 0.303455 May 31 21:07:55.149969 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 245/517] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:07:54 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1739 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:07:55.300810 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-6bd46307-a901-4267-b4fa-8042c3241f2c tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:55.301425 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-6bd46307-a901-4267-b4fa-8042c3241f2c tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] [instance: c59245fe-2b3a-4cea-85db-b7b8e0aea06f] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:55.308143 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-6bd46307-a901-4267-b4fa-8042c3241f2c tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:55.308887 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-6bd46307-a901-4267-b4fa-8042c3241f2c tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:55.309707 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-6bd46307-a901-4267-b4fa-8042c3241f2c tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:55.310182 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-6bd46307-a901-4267-b4fa-8042c3241f2c tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:55.462177 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-8d276046-5e2a-4262-b052-36d56f49205b tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Action: 'create', calling method: .version_select at 0x7fe7c0cb1430>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1276431592", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWBckqSB8OA6JAVZ/M8sAwkaV7SS79tNHZGLJMLQRGRNfasbPLWHJ2OVIYOxXh8h4OCkQV18UtIP/7vrxLtd/xaU6F8QH9FBM6HWQ3Soa4QQ5WUccYeSASxrmj0+3rjjg=="}} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:07:55.479774 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.quota [None req-8d276046-5e2a-4262-b052-36d56f49205b tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Getting quotas for project 8e511490c0f8438fb89ac590bd63529f. Resources: {'key_pairs'} {{(pid=118184) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 21:07:55.485203 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.quota [None req-8d276046-5e2a-4262-b052-36d56f49205b tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Getting quotas for user 546cd066c4244bffacbfea21f5e4f437 and project 8e511490c0f8438fb89ac590bd63529f. Resources: {'key_pairs'} {{(pid=118184) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 21:07:55.528975 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-6bd46307-a901-4267-b4fa-8042c3241f2c tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f0e0a07754669b7cb9f21502e5906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f722e284eda84b078c1c6935fb728f82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:55.537105 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-6bd46307-a901-4267-b4fa-8042c3241f2c tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] 10.222.0.55 "GET /compute/v2.1/servers/c59245fe-2b3a-4cea-85db-b7b8e0aea06f" status: 200 len: 1314 microversion: 2.1 time: 0.240113 May 31 21:07:55.537692 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 246/518] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:07:55 2022] GET /compute/v2.1/servers/c59245fe-2b3a-4cea-85db-b7b8e0aea06f => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:07:55.542482 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-321683d8-23d9-45d4-8dc2-94df33575a99 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:55.543092 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-321683d8-23d9-45d4-8dc2-94df33575a99 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:55.549357 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-321683d8-23d9-45d4-8dc2-94df33575a99 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:55.549812 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-321683d8-23d9-45d4-8dc2-94df33575a99 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:55.551590 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-321683d8-23d9-45d4-8dc2-94df33575a99 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:55.551590 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-321683d8-23d9-45d4-8dc2-94df33575a99 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:55.713726 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-321683d8-23d9-45d4-8dc2-94df33575a99 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:55.722874 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-321683d8-23d9-45d4-8dc2-94df33575a99 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1723 microversion: 2.1 time: 0.183876 May 31 21:07:55.727235 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 247/519] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:07:55 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:07:55.749973 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-8d276046-5e2a-4262-b052-36d56f49205b tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.532942 May 31 21:07:55.752334 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 273/520] 10.222.0.55 () {60 vars in 1158 bytes} [Tue May 31 21:07:55 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:07:56.169523 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-2ba4c62f-26ac-4054-b29a-0122524e4342 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:56.170797 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-2ba4c62f-26ac-4054-b29a-0122524e4342 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:56.186923 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-2ba4c62f-26ac-4054-b29a-0122524e4342 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:56.191036 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-2ba4c62f-26ac-4054-b29a-0122524e4342 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:56.193964 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-2ba4c62f-26ac-4054-b29a-0122524e4342 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:56.195058 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-2ba4c62f-26ac-4054-b29a-0122524e4342 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:56.429836 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-2ba4c62f-26ac-4054-b29a-0122524e4342 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:56.444617 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-2ba4c62f-26ac-4054-b29a-0122524e4342 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:56.449183 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-2ba4c62f-26ac-4054-b29a-0122524e4342 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:56.452640 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-2ba4c62f-26ac-4054-b29a-0122524e4342 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1739 microversion: 2.20 time: 0.286996 May 31 21:07:56.453291 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 248/521] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:07:56 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1739 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:07:56.557796 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-ecde299d-87b4-45df-95f3-9c0aa35d9ec2 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:56.571388 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-ecde299d-87b4-45df-95f3-9c0aa35d9ec2 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] [instance: c59245fe-2b3a-4cea-85db-b7b8e0aea06f] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:56.596024 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ecde299d-87b4-45df-95f3-9c0aa35d9ec2 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:56.596761 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ecde299d-87b4-45df-95f3-9c0aa35d9ec2 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:56.597812 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ecde299d-87b4-45df-95f3-9c0aa35d9ec2 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:56.598425 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ecde299d-87b4-45df-95f3-9c0aa35d9ec2 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:56.743036 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-dd39f848-a813-4f47-a925-156ced410afb tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:56.744139 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-dd39f848-a813-4f47-a925-156ced410afb tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:56.752991 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-dd39f848-a813-4f47-a925-156ced410afb tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:56.753441 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-dd39f848-a813-4f47-a925-156ced410afb tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:56.754808 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-dd39f848-a813-4f47-a925-156ced410afb tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:56.755516 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-dd39f848-a813-4f47-a925-156ced410afb tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:56.785038 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-ecde299d-87b4-45df-95f3-9c0aa35d9ec2 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f0e0a07754669b7cb9f21502e5906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f722e284eda84b078c1c6935fb728f82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:56.809472 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-ecde299d-87b4-45df-95f3-9c0aa35d9ec2 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] 10.222.0.55 "GET /compute/v2.1/servers/c59245fe-2b3a-4cea-85db-b7b8e0aea06f" status: 200 len: 1314 microversion: 2.1 time: 0.256627 May 31 21:07:56.810774 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 274/522] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:07:56 2022] GET /compute/v2.1/servers/c59245fe-2b3a-4cea-85db-b7b8e0aea06f => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:07:56.963802 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-dd39f848-a813-4f47-a925-156ced410afb tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:56.976093 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-dd39f848-a813-4f47-a925-156ced410afb tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1723 microversion: 2.1 time: 0.237983 May 31 21:07:56.976873 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 249/523] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:07:56 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1723 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:07:57.471784 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-4089b0e1-2490-47b4-ac1a-6400111e989a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:57.472976 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-4089b0e1-2490-47b4-ac1a-6400111e989a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:57.488672 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4089b0e1-2490-47b4-ac1a-6400111e989a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:57.489465 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4089b0e1-2490-47b4-ac1a-6400111e989a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:57.490580 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4089b0e1-2490-47b4-ac1a-6400111e989a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:57.491183 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4089b0e1-2490-47b4-ac1a-6400111e989a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:57.827662 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-4089b0e1-2490-47b4-ac1a-6400111e989a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:57.831293 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-61f21933-a17b-49f3-8de5-5dd00d1b4b8b tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:57.833313 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-61f21933-a17b-49f3-8de5-5dd00d1b4b8b tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] [instance: c59245fe-2b3a-4cea-85db-b7b8e0aea06f] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:57.843179 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-4089b0e1-2490-47b4-ac1a-6400111e989a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:57.846990 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-4089b0e1-2490-47b4-ac1a-6400111e989a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:57.848959 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-61f21933-a17b-49f3-8de5-5dd00d1b4b8b tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:57.849591 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-61f21933-a17b-49f3-8de5-5dd00d1b4b8b tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:57.850645 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-61f21933-a17b-49f3-8de5-5dd00d1b4b8b tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:57.851087 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-61f21933-a17b-49f3-8de5-5dd00d1b4b8b tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:57.854084 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-4089b0e1-2490-47b4-ac1a-6400111e989a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1739 microversion: 2.20 time: 0.387065 May 31 21:07:57.855667 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 275/524] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:07:57 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1739 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:07:57.997488 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-0ed5f879-0500-48c9-a6fc-c6c36e28c6c6 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:58.000191 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-0ed5f879-0500-48c9-a6fc-c6c36e28c6c6 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:58.012124 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-0ed5f879-0500-48c9-a6fc-c6c36e28c6c6 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:58.013100 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-0ed5f879-0500-48c9-a6fc-c6c36e28c6c6 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:58.014133 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-0ed5f879-0500-48c9-a6fc-c6c36e28c6c6 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:58.014746 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-0ed5f879-0500-48c9-a6fc-c6c36e28c6c6 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:58.412288 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-0ed5f879-0500-48c9-a6fc-c6c36e28c6c6 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:58.424822 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-0ed5f879-0500-48c9-a6fc-c6c36e28c6c6 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1723 microversion: 2.1 time: 0.432563 May 31 21:07:58.426277 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 276/525] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:07:57 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1723 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:07:58.444395 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-61f21933-a17b-49f3-8de5-5dd00d1b4b8b tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f0e0a07754669b7cb9f21502e5906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f722e284eda84b078c1c6935fb728f82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:58.451127 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-61f21933-a17b-49f3-8de5-5dd00d1b4b8b tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] 10.222.0.55 "GET /compute/v2.1/servers/c59245fe-2b3a-4cea-85db-b7b8e0aea06f" status: 200 len: 1314 microversion: 2.1 time: 0.627360 May 31 21:07:58.455480 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 250/526] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:07:57 2022] GET /compute/v2.1/servers/c59245fe-2b3a-4cea-85db-b7b8e0aea06f => generated 1314 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:07:58.874113 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-724146d8-775b-46d1-b652-bc9266a07743 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:58.875284 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-724146d8-775b-46d1-b652-bc9266a07743 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:58.882944 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-724146d8-775b-46d1-b652-bc9266a07743 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:58.883643 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-724146d8-775b-46d1-b652-bc9266a07743 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:58.884655 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-724146d8-775b-46d1-b652-bc9266a07743 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:58.885283 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-724146d8-775b-46d1-b652-bc9266a07743 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:59.113734 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-724146d8-775b-46d1-b652-bc9266a07743 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:59.125974 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-724146d8-775b-46d1-b652-bc9266a07743 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:59.128210 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-724146d8-775b-46d1-b652-bc9266a07743 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:59.130201 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-724146d8-775b-46d1-b652-bc9266a07743 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1739 microversion: 2.20 time: 0.260959 May 31 21:07:59.130936 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 277/527] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:07:58 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1739 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:07:59.445085 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-757c7ee8-7709-40d1-8fe3-af76c896c508 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:59.446089 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-757c7ee8-7709-40d1-8fe3-af76c896c508 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:59.464643 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-757c7ee8-7709-40d1-8fe3-af76c896c508 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:59.465112 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-757c7ee8-7709-40d1-8fe3-af76c896c508 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:59.469710 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-757c7ee8-7709-40d1-8fe3-af76c896c508 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:59.470584 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-757c7ee8-7709-40d1-8fe3-af76c896c508 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:59.482563 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-fbd1611e-2ad4-40b4-9ee5-9e8a4cbf9adb tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:07:59.483581 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-fbd1611e-2ad4-40b4-9ee5-9e8a4cbf9adb tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] [instance: c59245fe-2b3a-4cea-85db-b7b8e0aea06f] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:07:59.498386 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-fbd1611e-2ad4-40b4-9ee5-9e8a4cbf9adb tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:59.502803 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-fbd1611e-2ad4-40b4-9ee5-9e8a4cbf9adb tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:59.506291 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-fbd1611e-2ad4-40b4-9ee5-9e8a4cbf9adb tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:07:59.507817 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-fbd1611e-2ad4-40b4-9ee5-9e8a4cbf9adb tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:07:59.833415 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-fbd1611e-2ad4-40b4-9ee5-9e8a4cbf9adb tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f0e0a07754669b7cb9f21502e5906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f722e284eda84b078c1c6935fb728f82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:59.847083 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-fbd1611e-2ad4-40b4-9ee5-9e8a4cbf9adb tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] 10.222.0.55 "GET /compute/v2.1/servers/c59245fe-2b3a-4cea-85db-b7b8e0aea06f" status: 200 len: 1314 microversion: 2.1 time: 0.378121 May 31 21:07:59.847776 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 278/528] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:07:59 2022] GET /compute/v2.1/servers/c59245fe-2b3a-4cea-85db-b7b8e0aea06f => generated 1314 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:07:59.864132 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-757c7ee8-7709-40d1-8fe3-af76c896c508 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:07:59.875990 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-757c7ee8-7709-40d1-8fe3-af76c896c508 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1723 microversion: 2.1 time: 0.435804 May 31 21:07:59.876645 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 251/529] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:07:59 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1723 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:08:00.148803 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-a5677531-9c7e-435f-a24a-a5f9774c4e80 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:00.149447 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-a5677531-9c7e-435f-a24a-a5f9774c4e80 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:00.156646 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a5677531-9c7e-435f-a24a-a5f9774c4e80 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:00.157097 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a5677531-9c7e-435f-a24a-a5f9774c4e80 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:00.157984 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a5677531-9c7e-435f-a24a-a5f9774c4e80 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:00.158347 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a5677531-9c7e-435f-a24a-a5f9774c4e80 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:00.355315 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-a5677531-9c7e-435f-a24a-a5f9774c4e80 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:00.370193 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-a5677531-9c7e-435f-a24a-a5f9774c4e80 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:00.372228 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-a5677531-9c7e-435f-a24a-a5f9774c4e80 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:00.373683 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-a5677531-9c7e-435f-a24a-a5f9774c4e80 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1739 microversion: 2.20 time: 0.228905 May 31 21:08:00.374491 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 279/530] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:08:00 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1739 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:08:00.761849 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [req-15ca597c-35d8-4468-8e8e-c4fea7f9d403 req-45e3c014-a74a-46a9-8861-65cb5aff6977 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c59245fe-2b3a-4cea-85db-b7b8e0aea06f", "name": "network-vif-plugged", "status": "completed", "tag": "6ff2f985-0e66-4260-9039-36545ea47a85"}]} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:08:00.777016 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-15ca597c-35d8-4468-8e8e-c4fea7f9d403 req-45e3c014-a74a-46a9-8861-65cb5aff6977 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:00.777631 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-15ca597c-35d8-4468-8e8e-c4fea7f9d403 req-45e3c014-a74a-46a9-8861-65cb5aff6977 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:00.794684 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.compute.server_external_events [req-15ca597c-35d8-4468-8e8e-c4fea7f9d403 req-45e3c014-a74a-46a9-8861-65cb5aff6977 service nova] Creating event network-vif-plugged:6ff2f985-0e66-4260-9039-36545ea47a85 for instance c59245fe-2b3a-4cea-85db-b7b8e0aea06f on hv-cinder-83979 May 31 21:08:00.812962 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [req-15ca597c-35d8-4468-8e8e-c4fea7f9d403 req-45e3c014-a74a-46a9-8861-65cb5aff6977 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054689 May 31 21:08:00.839268 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 252/531] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:08:00.866524 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-f4fda107-38b2-4867-9fe4-2241cb04b414 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:00.867920 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-f4fda107-38b2-4867-9fe4-2241cb04b414 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] [instance: c59245fe-2b3a-4cea-85db-b7b8e0aea06f] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:00.875082 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f4fda107-38b2-4867-9fe4-2241cb04b414 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:00.875452 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f4fda107-38b2-4867-9fe4-2241cb04b414 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:00.876381 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f4fda107-38b2-4867-9fe4-2241cb04b414 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:00.876824 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f4fda107-38b2-4867-9fe4-2241cb04b414 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:00.895070 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-883cc59f-a085-4ece-a46d-5d5f6e319408 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:00.896933 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-883cc59f-a085-4ece-a46d-5d5f6e319408 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:00.905067 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-883cc59f-a085-4ece-a46d-5d5f6e319408 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:00.906636 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-883cc59f-a085-4ece-a46d-5d5f6e319408 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:00.907707 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-883cc59f-a085-4ece-a46d-5d5f6e319408 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:00.908142 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-883cc59f-a085-4ece-a46d-5d5f6e319408 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:01.225821 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-f4fda107-38b2-4867-9fe4-2241cb04b414 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f0e0a07754669b7cb9f21502e5906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f722e284eda84b078c1c6935fb728f82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:01.235464 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-f4fda107-38b2-4867-9fe4-2241cb04b414 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] 10.222.0.55 "GET /compute/v2.1/servers/c59245fe-2b3a-4cea-85db-b7b8e0aea06f" status: 200 len: 1314 microversion: 2.1 time: 0.374327 May 31 21:08:01.236043 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 280/532] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:08:00 2022] GET /compute/v2.1/servers/c59245fe-2b3a-4cea-85db-b7b8e0aea06f => generated 1314 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:08:01.254072 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-883cc59f-a085-4ece-a46d-5d5f6e319408 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:01.265177 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-883cc59f-a085-4ece-a46d-5d5f6e319408 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1700 microversion: 2.1 time: 0.374408 May 31 21:08:01.272780 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 253/533] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:08:00 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1700 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:08:01.289953 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-a29a315c-22c5-4878-8034-9205ca69dc4b tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:08:01.297599 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a29a315c-22c5-4878-8034-9205ca69dc4b tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:01.298174 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a29a315c-22c5-4878-8034-9205ca69dc4b tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:01.391312 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-a29a315c-22c5-4878-8034-9205ca69dc4b tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Going to try to start instance {{(pid=118184) start /opt/stack/nova/nova/compute/api.py:2730}} May 31 21:08:01.400823 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-598bb217-952a-42d9-964d-b450d47c3599 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:01.401523 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-598bb217-952a-42d9-964d-b450d47c3599 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:01.409564 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-598bb217-952a-42d9-964d-b450d47c3599 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:01.410397 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-598bb217-952a-42d9-964d-b450d47c3599 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:01.415267 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-598bb217-952a-42d9-964d-b450d47c3599 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:01.415267 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-598bb217-952a-42d9-964d-b450d47c3599 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:01.573189 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-a29a315c-22c5-4878-8034-9205ca69dc4b tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "POST /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014/action" status: 202 len: 0 microversion: 2.1 time: 0.287071 May 31 21:08:01.573797 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 281/534] 10.222.0.55 () {60 vars in 1277 bytes} [Tue May 31 21:08:01 2022] POST /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014/action => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 21:08:01.583435 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-34ce87e5-b39f-49d2-8f6c-eb1eb418ba13 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:01.587396 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-34ce87e5-b39f-49d2-8f6c-eb1eb418ba13 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:01.601919 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-34ce87e5-b39f-49d2-8f6c-eb1eb418ba13 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:01.607967 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-34ce87e5-b39f-49d2-8f6c-eb1eb418ba13 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:01.609030 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-34ce87e5-b39f-49d2-8f6c-eb1eb418ba13 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:01.609639 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-34ce87e5-b39f-49d2-8f6c-eb1eb418ba13 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:01.611415 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-598bb217-952a-42d9-964d-b450d47c3599 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:01.633645 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-598bb217-952a-42d9-964d-b450d47c3599 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:01.635473 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-598bb217-952a-42d9-964d-b450d47c3599 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:01.639327 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-598bb217-952a-42d9-964d-b450d47c3599 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1739 microversion: 2.20 time: 0.242475 May 31 21:08:01.643014 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 254/535] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:08:01 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1739 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:08:01.837119 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-34ce87e5-b39f-49d2-8f6c-eb1eb418ba13 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:01.848549 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-34ce87e5-b39f-49d2-8f6c-eb1eb418ba13 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1709 microversion: 2.1 time: 0.269788 May 31 21:08:01.849613 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 282/536] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:08:01 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1709 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:08:02.253180 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-3e062d60-83e2-4088-805d-ed1562e7ccd0 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:02.254560 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-3e062d60-83e2-4088-805d-ed1562e7ccd0 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] [instance: c59245fe-2b3a-4cea-85db-b7b8e0aea06f] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:02.262286 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-3e062d60-83e2-4088-805d-ed1562e7ccd0 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:02.263630 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-3e062d60-83e2-4088-805d-ed1562e7ccd0 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:02.265946 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-3e062d60-83e2-4088-805d-ed1562e7ccd0 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:02.268464 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-3e062d60-83e2-4088-805d-ed1562e7ccd0 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:02.424924 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-3e062d60-83e2-4088-805d-ed1562e7ccd0 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f0e0a07754669b7cb9f21502e5906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f722e284eda84b078c1c6935fb728f82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:02.433404 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-3e062d60-83e2-4088-805d-ed1562e7ccd0 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] 10.222.0.55 "GET /compute/v2.1/servers/c59245fe-2b3a-4cea-85db-b7b8e0aea06f" status: 200 len: 1314 microversion: 2.1 time: 0.184042 May 31 21:08:02.434129 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 255/537] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:08:02 2022] GET /compute/v2.1/servers/c59245fe-2b3a-4cea-85db-b7b8e0aea06f => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:08:02.660731 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-86bc12f8-197b-4b8b-98f8-3469b6a4d566 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:02.661547 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-86bc12f8-197b-4b8b-98f8-3469b6a4d566 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:02.669709 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-86bc12f8-197b-4b8b-98f8-3469b6a4d566 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:02.670569 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-86bc12f8-197b-4b8b-98f8-3469b6a4d566 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:02.671603 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-86bc12f8-197b-4b8b-98f8-3469b6a4d566 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:02.672278 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-86bc12f8-197b-4b8b-98f8-3469b6a4d566 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:02.851027 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-86bc12f8-197b-4b8b-98f8-3469b6a4d566 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:02.861352 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-86bc12f8-197b-4b8b-98f8-3469b6a4d566 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:02.864219 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-86bc12f8-197b-4b8b-98f8-3469b6a4d566 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:02.865697 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-86bc12f8-197b-4b8b-98f8-3469b6a4d566 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1739 microversion: 2.20 time: 0.209048 May 31 21:08:02.866811 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 283/538] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:08:02 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1739 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:08:02.867878 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-da15abba-781e-4473-a608-7b09522d7c8d tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:02.868628 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-da15abba-781e-4473-a608-7b09522d7c8d tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:02.879097 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-da15abba-781e-4473-a608-7b09522d7c8d tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:02.879935 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-da15abba-781e-4473-a608-7b09522d7c8d tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:02.880952 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-da15abba-781e-4473-a608-7b09522d7c8d tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:02.881620 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-da15abba-781e-4473-a608-7b09522d7c8d tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:03.058127 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-da15abba-781e-4473-a608-7b09522d7c8d tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:03.069690 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-da15abba-781e-4473-a608-7b09522d7c8d tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1709 microversion: 2.1 time: 0.205833 May 31 21:08:03.070848 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 256/539] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:08:02 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1709 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:08:03.466672 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-f84d9e02-fbe1-4bd5-83ae-a59954f82c45 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:03.475031 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-f84d9e02-fbe1-4bd5-83ae-a59954f82c45 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] [instance: c59245fe-2b3a-4cea-85db-b7b8e0aea06f] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:03.477620 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f84d9e02-fbe1-4bd5-83ae-a59954f82c45 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:03.477877 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f84d9e02-fbe1-4bd5-83ae-a59954f82c45 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:03.481600 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f84d9e02-fbe1-4bd5-83ae-a59954f82c45 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:03.481600 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f84d9e02-fbe1-4bd5-83ae-a59954f82c45 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:03.663121 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-f84d9e02-fbe1-4bd5-83ae-a59954f82c45 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f0e0a07754669b7cb9f21502e5906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f722e284eda84b078c1c6935fb728f82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:03.672374 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-f84d9e02-fbe1-4bd5-83ae-a59954f82c45 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] 10.222.0.55 "GET /compute/v2.1/servers/c59245fe-2b3a-4cea-85db-b7b8e0aea06f" status: 200 len: 1314 microversion: 2.1 time: 0.216606 May 31 21:08:03.673075 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 284/540] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:08:03 2022] GET /compute/v2.1/servers/c59245fe-2b3a-4cea-85db-b7b8e0aea06f => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:08:03.884625 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-1cd58bfb-a139-4287-8d9a-f56393aa0991 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:03.885292 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-1cd58bfb-a139-4287-8d9a-f56393aa0991 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:03.887590 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_api:SELECT=64 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:08:03.892525 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-1cd58bfb-a139-4287-8d9a-f56393aa0991 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:03.892970 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-1cd58bfb-a139-4287-8d9a-f56393aa0991 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:03.893732 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-1cd58bfb-a139-4287-8d9a-f56393aa0991 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:03.900134 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-1cd58bfb-a139-4287-8d9a-f56393aa0991 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:04.049651 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-1cd58bfb-a139-4287-8d9a-f56393aa0991 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:04.058044 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-1cd58bfb-a139-4287-8d9a-f56393aa0991 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:04.060230 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-1cd58bfb-a139-4287-8d9a-f56393aa0991 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:04.061395 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-1cd58bfb-a139-4287-8d9a-f56393aa0991 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1739 microversion: 2.20 time: 0.180709 May 31 21:08:04.061973 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 257/541] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:08:03 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1739 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:08:04.088732 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-189e38e3-e6d4-4598-87a4-d182f4d25ef6 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:04.089346 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-189e38e3-e6d4-4598-87a4-d182f4d25ef6 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:04.096761 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-189e38e3-e6d4-4598-87a4-d182f4d25ef6 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:04.097284 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-189e38e3-e6d4-4598-87a4-d182f4d25ef6 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:04.098336 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-189e38e3-e6d4-4598-87a4-d182f4d25ef6 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:04.098815 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-189e38e3-e6d4-4598-87a4-d182f4d25ef6 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:04.239357 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-189e38e3-e6d4-4598-87a4-d182f4d25ef6 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:04.248661 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-189e38e3-e6d4-4598-87a4-d182f4d25ef6 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1709 microversion: 2.1 time: 0.163861 May 31 21:08:04.249258 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 285/542] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:08:04 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1709 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:08:04.695158 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-c901e04b-0e8e-471f-aac1-d40b00a1656f tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:04.695771 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-c901e04b-0e8e-471f-aac1-d40b00a1656f tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] [instance: c59245fe-2b3a-4cea-85db-b7b8e0aea06f] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:04.703121 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c901e04b-0e8e-471f-aac1-d40b00a1656f tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:04.703567 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c901e04b-0e8e-471f-aac1-d40b00a1656f tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:04.704343 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c901e04b-0e8e-471f-aac1-d40b00a1656f tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:04.704777 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c901e04b-0e8e-471f-aac1-d40b00a1656f tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:04.886317 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-c901e04b-0e8e-471f-aac1-d40b00a1656f tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f0e0a07754669b7cb9f21502e5906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f722e284eda84b078c1c6935fb728f82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:04.896053 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-c901e04b-0e8e-471f-aac1-d40b00a1656f tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] 10.222.0.55 "GET /compute/v2.1/servers/c59245fe-2b3a-4cea-85db-b7b8e0aea06f" status: 200 len: 1497 microversion: 2.1 time: 0.208784 May 31 21:08:04.897076 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 258/543] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:08:04 2022] GET /compute/v2.1/servers/c59245fe-2b3a-4cea-85db-b7b8e0aea06f => generated 1497 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:08:05.079966 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-4a49c258-4706-419a-868a-cb41cec64782 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:05.080610 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-4a49c258-4706-419a-868a-cb41cec64782 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:05.090435 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4a49c258-4706-419a-868a-cb41cec64782 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:05.090882 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4a49c258-4706-419a-868a-cb41cec64782 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:05.092012 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4a49c258-4706-419a-868a-cb41cec64782 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:05.092629 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4a49c258-4706-419a-868a-cb41cec64782 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:05.263218 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-4a49c258-4706-419a-868a-cb41cec64782 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:05.266121 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-dc2adffb-fe2a-42c8-baeb-a937dd17e6f7 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:05.266988 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-dc2adffb-fe2a-42c8-baeb-a937dd17e6f7 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:05.272237 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-4a49c258-4706-419a-868a-cb41cec64782 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:05.273796 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-4a49c258-4706-419a-868a-cb41cec64782 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:05.275808 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-dc2adffb-fe2a-42c8-baeb-a937dd17e6f7 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:05.276658 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-dc2adffb-fe2a-42c8-baeb-a937dd17e6f7 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:05.277134 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-4a49c258-4706-419a-868a-cb41cec64782 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1739 microversion: 2.20 time: 0.199303 May 31 21:08:05.278532 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-dc2adffb-fe2a-42c8-baeb-a937dd17e6f7 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:05.279014 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 286/544] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:08:05 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1739 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:08:05.279254 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-dc2adffb-fe2a-42c8-baeb-a937dd17e6f7 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:05.419600 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-dc2adffb-fe2a-42c8-baeb-a937dd17e6f7 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:05.428370 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-dc2adffb-fe2a-42c8-baeb-a937dd17e6f7 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1713 microversion: 2.1 time: 0.166586 May 31 21:08:05.430170 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 259/545] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:08:05 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1713 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:08:05.956823 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-97de788a-e797-4c33-9f07-5126a7d17b66 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:05.957315 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-97de788a-e797-4c33-9f07-5126a7d17b66 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] [instance: c59245fe-2b3a-4cea-85db-b7b8e0aea06f] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:05.959748 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell0:SELECT=4 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:08:05.965001 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-97de788a-e797-4c33-9f07-5126a7d17b66 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:05.965474 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-97de788a-e797-4c33-9f07-5126a7d17b66 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:05.966422 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-97de788a-e797-4c33-9f07-5126a7d17b66 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:05.967854 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-97de788a-e797-4c33-9f07-5126a7d17b66 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:05.975830 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:08:05.992421 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-97de788a-e797-4c33-9f07-5126a7d17b66 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] [instance: c59245fe-2b3a-4cea-85db-b7b8e0aea06f] Going to try to terminate instance {{(pid=118184) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 21:08:06.297948 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-af177738-dd03-46ab-8d14-41805bbd59b6 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:06.298672 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-af177738-dd03-46ab-8d14-41805bbd59b6 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:06.305498 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-af177738-dd03-46ab-8d14-41805bbd59b6 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:06.305971 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-af177738-dd03-46ab-8d14-41805bbd59b6 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:06.306768 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-af177738-dd03-46ab-8d14-41805bbd59b6 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:06.307201 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-af177738-dd03-46ab-8d14-41805bbd59b6 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:06.317562 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-97de788a-e797-4c33-9f07-5126a7d17b66 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] 10.222.0.55 "DELETE /compute/v2.1/servers/c59245fe-2b3a-4cea-85db-b7b8e0aea06f" status: 204 len: 0 microversion: 2.1 time: 0.364208 May 31 21:08:06.318284 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 287/546] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 31 21:08:05 2022] DELETE /compute/v2.1/servers/c59245fe-2b3a-4cea-85db-b7b8e0aea06f => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 31 21:08:06.328423 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-75bb1477-415b-43a9-9921-5a422fd9b3d9 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:06.331754 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-75bb1477-415b-43a9-9921-5a422fd9b3d9 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] [instance: c59245fe-2b3a-4cea-85db-b7b8e0aea06f] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:06.337271 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-75bb1477-415b-43a9-9921-5a422fd9b3d9 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:06.337769 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-75bb1477-415b-43a9-9921-5a422fd9b3d9 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:06.338585 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-75bb1477-415b-43a9-9921-5a422fd9b3d9 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:06.339020 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-75bb1477-415b-43a9-9921-5a422fd9b3d9 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:06.770891 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-af177738-dd03-46ab-8d14-41805bbd59b6 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:06.777576 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-75bb1477-415b-43a9-9921-5a422fd9b3d9 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f0e0a07754669b7cb9f21502e5906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f722e284eda84b078c1c6935fb728f82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:06.778912 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-af177738-dd03-46ab-8d14-41805bbd59b6 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:06.780532 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-af177738-dd03-46ab-8d14-41805bbd59b6 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:06.781807 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-af177738-dd03-46ab-8d14-41805bbd59b6 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1739 microversion: 2.20 time: 0.487890 May 31 21:08:06.782434 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 260/547] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:08:06 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1739 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:08:06.785697 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-75bb1477-415b-43a9-9921-5a422fd9b3d9 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] 10.222.0.55 "GET /compute/v2.1/servers/c59245fe-2b3a-4cea-85db-b7b8e0aea06f" status: 200 len: 1503 microversion: 2.1 time: 0.462515 May 31 21:08:06.786440 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 288/548] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:08:06 2022] GET /compute/v2.1/servers/c59245fe-2b3a-4cea-85db-b7b8e0aea06f => generated 1503 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:08:07.802837 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-f3789253-9a86-4688-b014-b7d97277eaec tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:07.803508 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-e47b72ca-981d-457e-91ab-b1d2dddf22f4 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:07.803859 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-f3789253-9a86-4688-b014-b7d97277eaec tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] [instance: c59245fe-2b3a-4cea-85db-b7b8e0aea06f] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:07.803947 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-e47b72ca-981d-457e-91ab-b1d2dddf22f4 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:07.810705 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e47b72ca-981d-457e-91ab-b1d2dddf22f4 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:07.810930 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f3789253-9a86-4688-b014-b7d97277eaec tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:07.811157 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e47b72ca-981d-457e-91ab-b1d2dddf22f4 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:07.811274 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f3789253-9a86-4688-b014-b7d97277eaec tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:07.811953 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f3789253-9a86-4688-b014-b7d97277eaec tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:07.812065 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e47b72ca-981d-457e-91ab-b1d2dddf22f4 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:07.812383 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f3789253-9a86-4688-b014-b7d97277eaec tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:07.812489 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e47b72ca-981d-457e-91ab-b1d2dddf22f4 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:07.835177 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell1:SELECT=100 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:08:08.023143 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-f3789253-9a86-4688-b014-b7d97277eaec tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f0e0a07754669b7cb9f21502e5906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f722e284eda84b078c1c6935fb728f82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:08.027091 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-e47b72ca-981d-457e-91ab-b1d2dddf22f4 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:08.031566 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-f3789253-9a86-4688-b014-b7d97277eaec tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] 10.222.0.55 "GET /compute/v2.1/servers/c59245fe-2b3a-4cea-85db-b7b8e0aea06f" status: 200 len: 1503 microversion: 2.1 time: 0.232555 May 31 21:08:08.032138 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 289/549] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:08:07 2022] GET /compute/v2.1/servers/c59245fe-2b3a-4cea-85db-b7b8e0aea06f => generated 1503 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:08:08.047805 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-e47b72ca-981d-457e-91ab-b1d2dddf22f4 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:08.049400 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-e47b72ca-981d-457e-91ab-b1d2dddf22f4 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:08.050700 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-e47b72ca-981d-457e-91ab-b1d2dddf22f4 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1739 microversion: 2.20 time: 0.251841 May 31 21:08:08.051274 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 261/550] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:08:07 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1739 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:08:09.053343 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-9d435d9f-e555-4b39-bf3a-295c4df43740 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:09.054729 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-9d435d9f-e555-4b39-bf3a-295c4df43740 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] [instance: c59245fe-2b3a-4cea-85db-b7b8e0aea06f] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:09.070707 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-9652bf74-55f5-41ee-acda-f767ed6e5cce tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:09.071619 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-9652bf74-55f5-41ee-acda-f767ed6e5cce tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:09.076132 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-9d435d9f-e555-4b39-bf3a-295c4df43740 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:09.081366 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-9d435d9f-e555-4b39-bf3a-295c4df43740 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:09.082318 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-9d435d9f-e555-4b39-bf3a-295c4df43740 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:09.086086 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-9d435d9f-e555-4b39-bf3a-295c4df43740 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:09.092119 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9652bf74-55f5-41ee-acda-f767ed6e5cce tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:09.092566 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9652bf74-55f5-41ee-acda-f767ed6e5cce tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:09.093351 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9652bf74-55f5-41ee-acda-f767ed6e5cce tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:09.093785 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9652bf74-55f5-41ee-acda-f767ed6e5cce tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:09.207539 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-9d435d9f-e555-4b39-bf3a-295c4df43740 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f0e0a07754669b7cb9f21502e5906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f722e284eda84b078c1c6935fb728f82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:09.217118 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-9d435d9f-e555-4b39-bf3a-295c4df43740 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] 10.222.0.55 "GET /compute/v2.1/servers/c59245fe-2b3a-4cea-85db-b7b8e0aea06f" status: 200 len: 1461 microversion: 2.1 time: 0.169269 May 31 21:08:09.217705 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 290/551] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:08:09 2022] GET /compute/v2.1/servers/c59245fe-2b3a-4cea-85db-b7b8e0aea06f => generated 1461 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:08:09.232236 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [req-370eb67a-8176-4132-b3b1-00b4967e5a4b req-28458582-0680-45c0-829c-402568b5656e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c59245fe-2b3a-4cea-85db-b7b8e0aea06f", "name": "network-vif-deleted", "tag": "6ff2f985-0e66-4260-9039-36545ea47a85"}]} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:08:09.241239 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-370eb67a-8176-4132-b3b1-00b4967e5a4b req-28458582-0680-45c0-829c-402568b5656e service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:09.241680 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-370eb67a-8176-4132-b3b1-00b4967e5a4b req-28458582-0680-45c0-829c-402568b5656e service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:09.254925 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.compute.server_external_events [req-370eb67a-8176-4132-b3b1-00b4967e5a4b req-28458582-0680-45c0-829c-402568b5656e service nova] Creating event network-vif-deleted:6ff2f985-0e66-4260-9039-36545ea47a85 for instance c59245fe-2b3a-4cea-85db-b7b8e0aea06f on hv-cinder-83979 May 31 21:08:09.260515 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [req-370eb67a-8176-4132-b3b1-00b4967e5a4b req-28458582-0680-45c0-829c-402568b5656e service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032467 May 31 21:08:09.261128 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 291/552] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:08:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:08:09.292523 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-9652bf74-55f5-41ee-acda-f767ed6e5cce tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:09.306161 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-9652bf74-55f5-41ee-acda-f767ed6e5cce tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:09.307644 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-9652bf74-55f5-41ee-acda-f767ed6e5cce tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:09.308864 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-9652bf74-55f5-41ee-acda-f767ed6e5cce tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1721 microversion: 2.20 time: 0.243785 May 31 21:08:09.310136 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 262/553] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:08:09 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1721 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:08:10.235089 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-e70b5257-96c6-4c17-a29a-fe5e12b8c2f0 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:10.235694 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-e70b5257-96c6-4c17-a29a-fe5e12b8c2f0 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] [instance: c59245fe-2b3a-4cea-85db-b7b8e0aea06f] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:10.242714 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e70b5257-96c6-4c17-a29a-fe5e12b8c2f0 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:10.243158 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e70b5257-96c6-4c17-a29a-fe5e12b8c2f0 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:10.243926 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e70b5257-96c6-4c17-a29a-fe5e12b8c2f0 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:10.244358 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e70b5257-96c6-4c17-a29a-fe5e12b8c2f0 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:10.312831 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-e70b5257-96c6-4c17-a29a-fe5e12b8c2f0 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f0e0a07754669b7cb9f21502e5906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f722e284eda84b078c1c6935fb728f82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:10.320619 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-e70b5257-96c6-4c17-a29a-fe5e12b8c2f0 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] 10.222.0.55 "GET /compute/v2.1/servers/c59245fe-2b3a-4cea-85db-b7b8e0aea06f" status: 200 len: 1461 microversion: 2.1 time: 0.089762 May 31 21:08:10.321194 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 292/554] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:08:10 2022] GET /compute/v2.1/servers/c59245fe-2b3a-4cea-85db-b7b8e0aea06f => generated 1461 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:08:10.330821 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-411de4a8-d89a-4c61-ab35-da62286882a8 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:10.334514 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-411de4a8-d89a-4c61-ab35-da62286882a8 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:10.338651 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-411de4a8-d89a-4c61-ab35-da62286882a8 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:10.339230 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-411de4a8-d89a-4c61-ab35-da62286882a8 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:10.340433 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-411de4a8-d89a-4c61-ab35-da62286882a8 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:10.340878 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-411de4a8-d89a-4c61-ab35-da62286882a8 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:10.499408 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-411de4a8-d89a-4c61-ab35-da62286882a8 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:10.508847 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-411de4a8-d89a-4c61-ab35-da62286882a8 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:10.510525 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-411de4a8-d89a-4c61-ab35-da62286882a8 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:10.511803 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-411de4a8-d89a-4c61-ab35-da62286882a8 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1721 microversion: 2.20 time: 0.184844 May 31 21:08:10.512480 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 263/555] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:08:10 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1721 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:08:10.633744 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [req-45e3a445-f1d3-4eac-8679-3542cc4fcfde req-b6d65fd4-60f8-40e5-b112-0b6e97c77adc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a123764b-4693-41b1-bad8-a1a63cc951cd", "name": "network-vif-unplugged", "status": "completed", "tag": "cc0edf95-fc02-451a-b38f-075bee275ed6"}]} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:08:10.642884 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-45e3a445-f1d3-4eac-8679-3542cc4fcfde req-b6d65fd4-60f8-40e5-b112-0b6e97c77adc service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:10.643336 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-45e3a445-f1d3-4eac-8679-3542cc4fcfde req-b6d65fd4-60f8-40e5-b112-0b6e97c77adc service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:10.655470 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.compute.server_external_events [req-45e3a445-f1d3-4eac-8679-3542cc4fcfde req-b6d65fd4-60f8-40e5-b112-0b6e97c77adc service nova] Creating event network-vif-unplugged:cc0edf95-fc02-451a-b38f-075bee275ed6 for instance a123764b-4693-41b1-bad8-a1a63cc951cd on hv-cinder-83979 May 31 21:08:10.660477 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [req-45e3a445-f1d3-4eac-8679-3542cc4fcfde req-b6d65fd4-60f8-40e5-b112-0b6e97c77adc service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030425 May 31 21:08:10.661250 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 293/556] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:08:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:08:11.338729 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-99506693-0317-4537-90f4-51bebc3ec5f4 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:11.339276 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-99506693-0317-4537-90f4-51bebc3ec5f4 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] [instance: c59245fe-2b3a-4cea-85db-b7b8e0aea06f] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:11.346590 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-99506693-0317-4537-90f4-51bebc3ec5f4 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:11.347102 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-99506693-0317-4537-90f4-51bebc3ec5f4 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:11.348042 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-99506693-0317-4537-90f4-51bebc3ec5f4 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:11.348487 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-99506693-0317-4537-90f4-51bebc3ec5f4 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:11.382245 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-99506693-0317-4537-90f4-51bebc3ec5f4 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:11.382696 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-99506693-0317-4537-90f4-51bebc3ec5f4 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:11.383238 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.objects.instance [None req-99506693-0317-4537-90f4-51bebc3ec5f4 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lazy-loading 'fault' on Instance uuid c59245fe-2b3a-4cea-85db-b7b8e0aea06f {{(pid=118185) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 21:08:11.425065 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-99506693-0317-4537-90f4-51bebc3ec5f4 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757f0e0a07754669b7cb9f21502e5906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f722e284eda84b078c1c6935fb728f82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:11.440622 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-99506693-0317-4537-90f4-51bebc3ec5f4 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] 10.222.0.55 "GET /compute/v2.1/servers/c59245fe-2b3a-4cea-85db-b7b8e0aea06f" status: 200 len: 1304 microversion: 2.1 time: 0.105360 May 31 21:08:11.441667 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 264/557] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:08:11 2022] GET /compute/v2.1/servers/c59245fe-2b3a-4cea-85db-b7b8e0aea06f => generated 1304 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:08:11.533141 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-787f9a59-5f27-42f9-bdd1-8d87ec6a1066 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:11.533836 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-787f9a59-5f27-42f9-bdd1-8d87ec6a1066 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:11.540404 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-787f9a59-5f27-42f9-bdd1-8d87ec6a1066 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:11.540858 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-787f9a59-5f27-42f9-bdd1-8d87ec6a1066 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:11.541630 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-787f9a59-5f27-42f9-bdd1-8d87ec6a1066 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:11.542103 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-787f9a59-5f27-42f9-bdd1-8d87ec6a1066 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:11.692405 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-787f9a59-5f27-42f9-bdd1-8d87ec6a1066 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:11.702086 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-787f9a59-5f27-42f9-bdd1-8d87ec6a1066 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:11.703854 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-787f9a59-5f27-42f9-bdd1-8d87ec6a1066 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:11.705300 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-787f9a59-5f27-42f9-bdd1-8d87ec6a1066 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1721 microversion: 2.20 time: 0.177519 May 31 21:08:11.705908 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 294/558] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:08:11 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:08:12.458999 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-e941c508-1f94-4e00-b249-f998795fc6a0 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:12.459605 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-e941c508-1f94-4e00-b249-f998795fc6a0 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] [instance: c59245fe-2b3a-4cea-85db-b7b8e0aea06f] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:12.466706 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e941c508-1f94-4e00-b249-f998795fc6a0 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:12.467153 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e941c508-1f94-4e00-b249-f998795fc6a0 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:12.467910 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e941c508-1f94-4e00-b249-f998795fc6a0 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:12.468344 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e941c508-1f94-4e00-b249-f998795fc6a0 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:12.482503 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.wsgi [None req-e941c508-1f94-4e00-b249-f998795fc6a0 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] HTTP exception thrown: Instance c59245fe-2b3a-4cea-85db-b7b8e0aea06f could not be found. May 31 21:08:12.484163 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-e941c508-1f94-4e00-b249-f998795fc6a0 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Request method failure captured: May 31 21:08:12.484163 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: request: GET /compute/v2.1/servers/c59245fe-2b3a-4cea-85db-b7b8e0aea06f HTTP/1.1 May 31 21:08:12.484163 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Accept: application/json May 31 21:08:12.484163 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Accept-Encoding: identity May 31 21:08:12.484163 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Connection: close May 31 21:08:12.484163 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Content-Length: 0 May 31 21:08:12.484163 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Content-Type: application/json May 31 21:08:12.484163 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Host: 10.222.0.55 May 31 21:08:12.484163 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Openstack-System-Scope: None May 31 21:08:12.484163 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: User-Agent: python-urllib3/1.26.9 May 31 21:08:12.484163 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Auth-Token: gAAAAABiloN0QMqEVRq10e6FXQfKkePhMF8zqQGl2fGTUSk0Jq8IPugPP3DrB2LoHhws7gRSuGYmZredum7IdgK249M0-3R1m-hUirkuHzoERTaPHOLZ17HK7yKoH1z2lVm-Tucd1Y9lPzGQfySAAYt4-zQTY8DiMUXOVy2imzHVrMWH4RI9HIU May 31 21:08:12.484163 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Domain-Id: None May 31 21:08:12.484163 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Domain-Name: None May 31 21:08:12.484163 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Identity-Status: Confirmed May 31 21:08:12.484163 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Is-Admin-Project: True May 31 21:08:12.484163 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Domain-Id: default May 31 21:08:12.484163 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Domain-Name: Default May 31 21:08:12.484163 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Id: f722e284eda84b078c1c6935fb728f82 May 31 21:08:12.484163 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Name: tempest-VolumesActionsTest-897468629 May 31 21:08:12.484163 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Role: member,reader May 31 21:08:12.484163 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Roles: member,reader May 31 21:08:12.485774 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/f722e284eda84b078c1c6935fb728f82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f722e284eda84b078c1c6935fb728f82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_f722e284eda84b078c1c6935fb728f82", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f722e284eda84b078c1c6935fb728f82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] May 31 21:08:12.485774 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant: tempest-VolumesActionsTest-897468629 May 31 21:08:12.485774 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant-Id: f722e284eda84b078c1c6935fb728f82 May 31 21:08:12.485774 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant-Name: tempest-VolumesActionsTest-897468629 May 31 21:08:12.485774 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User: tempest-VolumesActionsTest-897468629-project May 31 21:08:12.485774 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Domain-Id: default May 31 21:08:12.485774 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Domain-Name: Default May 31 21:08:12.485774 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Id: 757f0e0a07754669b7cb9f21502e5906 May 31 21:08:12.485774 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Name: tempest-VolumesActionsTest-897468629-project May 31 21:08:12.485774 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: method: > May 31 21:08:12.485774 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: exception: Instance c59245fe-2b3a-4cea-85db-b7b8e0aea06f could not be found. May 31 21:08:12.485774 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: action_args: {'id': 'c59245fe-2b3a-4cea-85db-b7b8e0aea06f'} May 31 21:08:12.486634 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 21:08:12.486634 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:08:12.486634 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 21:08:12.486634 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 21:08:12.486634 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 21:08:12.486634 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 21:08:12.486634 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 21:08:12.486634 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 21:08:12.486634 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 21:08:12.486634 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 21:08:12.486634 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c59245fe-2b3a-4cea-85db-b7b8e0aea06f could not be found. May 31 21:08:12.486634 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:08:12.486634 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:08:12.486634 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:08:12.486634 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:08:12.486634 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:08:12.486634 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:08:12.486634 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 21:08:12.486634 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 21:08:12.486634 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 21:08:12.488145 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 21:08:12.488145 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 21:08:12.488145 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 21:08:12.488145 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 21:08:12.488145 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 21:08:12.488145 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 21:08:12.488145 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 21:08:12.488145 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c59245fe-2b3a-4cea-85db-b7b8e0aea06f could not be found. May 31 21:08:12.488145 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:08:12.488145 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:08:12.488145 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:08:12.488145 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:08:12.488145 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:08:12.488145 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:08:12.488145 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 21:08:12.488145 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 21:08:12.488145 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c59245fe-2b3a-4cea-85db-b7b8e0aea06f could not be found. May 31 21:08:12.488145 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:08:12.489399 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-e941c508-1f94-4e00-b249-f998795fc6a0 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] Returning 404 to user: Instance c59245fe-2b3a-4cea-85db-b7b8e0aea06f could not be found. {{(pid=118185) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 21:08:12.489399 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-e941c508-1f94-4e00-b249-f998795fc6a0 tempest-VolumesActionsTest-897468629 tempest-VolumesActionsTest-897468629-project] 10.222.0.55 "GET /compute/v2.1/servers/c59245fe-2b3a-4cea-85db-b7b8e0aea06f" status: 404 len: 111 microversion: 2.1 time: 0.030922 May 31 21:08:12.489399 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 265/559] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:08:12 2022] GET /compute/v2.1/servers/c59245fe-2b3a-4cea-85db-b7b8e0aea06f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 21:08:12.723421 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-90dc0b7c-ac61-4f8c-a96b-1c25e4b0fcd7 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:12.723967 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-90dc0b7c-ac61-4f8c-a96b-1c25e4b0fcd7 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:12.730170 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-90dc0b7c-ac61-4f8c-a96b-1c25e4b0fcd7 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:12.730617 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-90dc0b7c-ac61-4f8c-a96b-1c25e4b0fcd7 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:12.731905 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-90dc0b7c-ac61-4f8c-a96b-1c25e4b0fcd7 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:12.732339 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-90dc0b7c-ac61-4f8c-a96b-1c25e4b0fcd7 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:12.876418 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-90dc0b7c-ac61-4f8c-a96b-1c25e4b0fcd7 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:12.885312 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-90dc0b7c-ac61-4f8c-a96b-1c25e4b0fcd7 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:12.886850 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-90dc0b7c-ac61-4f8c-a96b-1c25e4b0fcd7 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:12.888527 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-90dc0b7c-ac61-4f8c-a96b-1c25e4b0fcd7 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1664 microversion: 2.20 time: 0.169099 May 31 21:08:12.889082 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 295/560] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:08:12 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1664 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:08:12.915675 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-405d2318-ab5d-4175-9c7e-7661a24e5800 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "829bd895-8285-418d-8856-9fcb64fec960"}} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:08:12.916824 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-405d2318-ab5d-4175-9c7e-7661a24e5800 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:12.923173 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-405d2318-ab5d-4175-9c7e-7661a24e5800 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:12.923627 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-405d2318-ab5d-4175-9c7e-7661a24e5800 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:12.924397 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-405d2318-ab5d-4175-9c7e-7661a24e5800 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:12.924842 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-405d2318-ab5d-4175-9c7e-7661a24e5800 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:14.065700 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-405d2318-ab5d-4175-9c7e-7661a24e5800 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "POST /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.154067 May 31 21:08:14.067272 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 266/561] 10.222.0.55 () {62 vars in 1363 bytes} [Tue May 31 21:08:12 2022] POST /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd/os-volume_attachments => generated 188 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 21:08:14.181033 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-c867d886-080a-433f-a71a-d77039230b01 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:08:14.183910 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-c867d886-080a-433f-a71a-d77039230b01 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:14.189037 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c867d886-080a-433f-a71a-d77039230b01 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:14.189671 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c867d886-080a-433f-a71a-d77039230b01 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:14.190464 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c867d886-080a-433f-a71a-d77039230b01 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:14.190897 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c867d886-080a-433f-a71a-d77039230b01 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:14.548291 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-c867d886-080a-433f-a71a-d77039230b01 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "POST /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd/action" status: 202 len: 0 microversion: 2.20 time: 0.371048 May 31 21:08:14.548775 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 296/562] 10.222.0.55 () {62 vars in 1318 bytes} [Tue May 31 21:08:14 2022] POST /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd/action => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 31 21:08:14.556913 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-9eb36b94-7be6-4a66-9988-cd07305bb0c6 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:14.557531 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-9eb36b94-7be6-4a66-9988-cd07305bb0c6 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:14.566069 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9eb36b94-7be6-4a66-9988-cd07305bb0c6 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:14.572826 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9eb36b94-7be6-4a66-9988-cd07305bb0c6 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:14.572826 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9eb36b94-7be6-4a66-9988-cd07305bb0c6 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:14.572826 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9eb36b94-7be6-4a66-9988-cd07305bb0c6 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:14.706268 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-9eb36b94-7be6-4a66-9988-cd07305bb0c6 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:14.715351 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-9eb36b94-7be6-4a66-9988-cd07305bb0c6 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:14.716855 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-9eb36b94-7be6-4a66-9988-cd07305bb0c6 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:14.718106 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-9eb36b94-7be6-4a66-9988-cd07305bb0c6 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1750 microversion: 2.20 time: 0.165085 May 31 21:08:14.718655 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 267/563] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:08:14 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1750 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:08:15.737452 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-024d7493-2581-4a3b-b1ef-6fa4d5af16d7 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:15.738246 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-024d7493-2581-4a3b-b1ef-6fa4d5af16d7 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:15.744198 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-024d7493-2581-4a3b-b1ef-6fa4d5af16d7 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:15.744636 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-024d7493-2581-4a3b-b1ef-6fa4d5af16d7 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:15.745388 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-024d7493-2581-4a3b-b1ef-6fa4d5af16d7 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:15.745817 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-024d7493-2581-4a3b-b1ef-6fa4d5af16d7 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:15.881987 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-024d7493-2581-4a3b-b1ef-6fa4d5af16d7 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:15.891138 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-024d7493-2581-4a3b-b1ef-6fa4d5af16d7 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:15.892637 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-024d7493-2581-4a3b-b1ef-6fa4d5af16d7 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:15.893780 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-024d7493-2581-4a3b-b1ef-6fa4d5af16d7 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1750 microversion: 2.20 time: 0.161048 May 31 21:08:15.894371 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 297/564] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:08:15 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1750 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:08:16.912717 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-3504e395-ab9c-413e-b0f1-960bf72a1bea tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:16.913325 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-3504e395-ab9c-413e-b0f1-960bf72a1bea tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:16.920136 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-3504e395-ab9c-413e-b0f1-960bf72a1bea tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:16.920587 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-3504e395-ab9c-413e-b0f1-960bf72a1bea tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:16.921359 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-3504e395-ab9c-413e-b0f1-960bf72a1bea tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:16.921799 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-3504e395-ab9c-413e-b0f1-960bf72a1bea tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:17.063175 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-3504e395-ab9c-413e-b0f1-960bf72a1bea tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:17.071967 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-3504e395-ab9c-413e-b0f1-960bf72a1bea tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:17.073645 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-3504e395-ab9c-413e-b0f1-960bf72a1bea tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:17.075407 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-3504e395-ab9c-413e-b0f1-960bf72a1bea tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1750 microversion: 2.20 time: 0.166131 May 31 21:08:17.075986 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 268/565] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:08:16 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1750 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 21:08:18.094796 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-18fe67d7-3482-4f18-bb37-063159da4edd tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:18.095477 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-18fe67d7-3482-4f18-bb37-063159da4edd tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:18.102646 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-18fe67d7-3482-4f18-bb37-063159da4edd tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:18.103084 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-18fe67d7-3482-4f18-bb37-063159da4edd tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:18.103946 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-18fe67d7-3482-4f18-bb37-063159da4edd tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:18.104370 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-18fe67d7-3482-4f18-bb37-063159da4edd tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:18.239272 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-18fe67d7-3482-4f18-bb37-063159da4edd tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:18.247932 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-18fe67d7-3482-4f18-bb37-063159da4edd tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:18.249614 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-18fe67d7-3482-4f18-bb37-063159da4edd tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:18.250781 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-18fe67d7-3482-4f18-bb37-063159da4edd tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1752 microversion: 2.20 time: 0.160659 May 31 21:08:18.251335 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 298/566] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:08:18 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1752 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:08:19.268674 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-c2a56d02-d222-4086-b24f-8153f2af55db tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:19.269278 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-c2a56d02-d222-4086-b24f-8153f2af55db tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:19.275790 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c2a56d02-d222-4086-b24f-8153f2af55db tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:19.276270 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c2a56d02-d222-4086-b24f-8153f2af55db tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:19.277053 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c2a56d02-d222-4086-b24f-8153f2af55db tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:19.277490 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c2a56d02-d222-4086-b24f-8153f2af55db tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:19.458105 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-c2a56d02-d222-4086-b24f-8153f2af55db tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:19.467425 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-c2a56d02-d222-4086-b24f-8153f2af55db tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:19.468926 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-c2a56d02-d222-4086-b24f-8153f2af55db tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:19.470109 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-c2a56d02-d222-4086-b24f-8153f2af55db tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1752 microversion: 2.20 time: 0.205366 May 31 21:08:19.470672 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 269/567] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:08:19 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1752 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:08:20.488878 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-a3d0015e-be6f-458a-a00c-b2f69959152f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:20.489879 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-a3d0015e-be6f-458a-a00c-b2f69959152f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:20.498633 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a3d0015e-be6f-458a-a00c-b2f69959152f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:20.499197 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a3d0015e-be6f-458a-a00c-b2f69959152f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:20.500158 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a3d0015e-be6f-458a-a00c-b2f69959152f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:20.500588 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a3d0015e-be6f-458a-a00c-b2f69959152f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:20.690218 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-a3d0015e-be6f-458a-a00c-b2f69959152f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:20.698955 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-a3d0015e-be6f-458a-a00c-b2f69959152f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:20.700498 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-a3d0015e-be6f-458a-a00c-b2f69959152f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:20.701647 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-a3d0015e-be6f-458a-a00c-b2f69959152f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1752 microversion: 2.20 time: 0.216976 May 31 21:08:20.702401 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 299/568] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:08:20 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1752 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:08:21.720737 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-2c9179fb-6523-47e0-ad0c-544a4fbb478f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:21.721339 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-2c9179fb-6523-47e0-ad0c-544a4fbb478f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:21.728152 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-2c9179fb-6523-47e0-ad0c-544a4fbb478f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:21.728910 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-2c9179fb-6523-47e0-ad0c-544a4fbb478f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:21.729456 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-2c9179fb-6523-47e0-ad0c-544a4fbb478f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:21.729907 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-2c9179fb-6523-47e0-ad0c-544a4fbb478f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:21.881301 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-2c9179fb-6523-47e0-ad0c-544a4fbb478f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:21.890769 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-2c9179fb-6523-47e0-ad0c-544a4fbb478f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:21.892309 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-2c9179fb-6523-47e0-ad0c-544a4fbb478f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:21.893538 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-2c9179fb-6523-47e0-ad0c-544a4fbb478f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1752 microversion: 2.20 time: 0.176855 May 31 21:08:21.895260 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 270/569] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:08:21 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1752 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:08:22.913981 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-44498de6-15a4-4769-9dd5-842e230e91a9 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:22.916217 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-44498de6-15a4-4769-9dd5-842e230e91a9 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:22.921694 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:08:22.926941 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-44498de6-15a4-4769-9dd5-842e230e91a9 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:22.927480 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-44498de6-15a4-4769-9dd5-842e230e91a9 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:22.928353 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-44498de6-15a4-4769-9dd5-842e230e91a9 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:22.929004 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-44498de6-15a4-4769-9dd5-842e230e91a9 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:23.139488 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-44498de6-15a4-4769-9dd5-842e230e91a9 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:23.154031 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-44498de6-15a4-4769-9dd5-842e230e91a9 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:23.156794 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-44498de6-15a4-4769-9dd5-842e230e91a9 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:23.158521 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-44498de6-15a4-4769-9dd5-842e230e91a9 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1808 microversion: 2.20 time: 0.249129 May 31 21:08:23.159598 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 300/570] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:08:22 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1808 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:08:24.183933 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-67a15bcd-597e-4beb-a61f-961aa7a7338f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:24.186841 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-67a15bcd-597e-4beb-a61f-961aa7a7338f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:24.214597 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-67a15bcd-597e-4beb-a61f-961aa7a7338f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:24.215796 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-67a15bcd-597e-4beb-a61f-961aa7a7338f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:24.217232 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-67a15bcd-597e-4beb-a61f-961aa7a7338f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:24.218128 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-67a15bcd-597e-4beb-a61f-961aa7a7338f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:24.407369 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-67a15bcd-597e-4beb-a61f-961aa7a7338f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:24.417190 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-67a15bcd-597e-4beb-a61f-961aa7a7338f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:24.419522 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-67a15bcd-597e-4beb-a61f-961aa7a7338f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:24.420954 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-67a15bcd-597e-4beb-a61f-961aa7a7338f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1808 microversion: 2.20 time: 0.244442 May 31 21:08:24.422038 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 271/571] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:08:24 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1808 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:08:25.447904 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-d8abf60c-9441-457e-9fc3-150ef6e6e66f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:25.449241 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-d8abf60c-9441-457e-9fc3-150ef6e6e66f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:25.464838 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d8abf60c-9441-457e-9fc3-150ef6e6e66f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:25.464838 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d8abf60c-9441-457e-9fc3-150ef6e6e66f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:25.464838 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d8abf60c-9441-457e-9fc3-150ef6e6e66f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:25.464838 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d8abf60c-9441-457e-9fc3-150ef6e6e66f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:25.638220 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-d8abf60c-9441-457e-9fc3-150ef6e6e66f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:25.650046 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-d8abf60c-9441-457e-9fc3-150ef6e6e66f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:25.652232 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-d8abf60c-9441-457e-9fc3-150ef6e6e66f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:25.654270 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-d8abf60c-9441-457e-9fc3-150ef6e6e66f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1808 microversion: 2.20 time: 0.210223 May 31 21:08:25.656106 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 301/572] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:08:25 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1808 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:08:26.477233 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-92f2d1a0-34d2-455b-8a15-6b4e365e7660 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1813966538", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1276431592", "security_groups": [{"name": "tempest-secgroup-smoke-506263611"}], "block_device_mapping_v2": [{"uuid": "62bbc2be-5003-454f-9e2a-cc350298eb61", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2c2f81e7-9a7d-4701-bf43-a528a17f585a"}]}} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:08:26.649081 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.network.neutron [None req-92f2d1a0-34d2-455b-8a15-6b4e365e7660 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] validate_networks() for [('2c2f81e7-9a7d-4701-bf43-a528a17f585a', None, None, None, None, None)] {{(pid=118185) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 21:08:26.682976 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-100ffbb7-94f0-4f42-8d14-c481f16f68a3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:26.685178 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-100ffbb7-94f0-4f42-8d14-c481f16f68a3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:26.701294 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-100ffbb7-94f0-4f42-8d14-c481f16f68a3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:26.702316 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-100ffbb7-94f0-4f42-8d14-c481f16f68a3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:26.703343 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-100ffbb7-94f0-4f42-8d14-c481f16f68a3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:26.704022 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-100ffbb7-94f0-4f42-8d14-c481f16f68a3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:26.740772 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:08:26.972183 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-100ffbb7-94f0-4f42-8d14-c481f16f68a3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:26.985606 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-100ffbb7-94f0-4f42-8d14-c481f16f68a3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:26.990190 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-100ffbb7-94f0-4f42-8d14-c481f16f68a3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:26.991927 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-100ffbb7-94f0-4f42-8d14-c481f16f68a3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1808 microversion: 2.20 time: 0.313491 May 31 21:08:27.003428 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 302/573] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:08:26 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1808 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:08:27.484307 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.virt.hardware [None req-92f2d1a0-34d2-455b-8a15-6b4e365e7660 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Flavor limits 0:0:0 {{(pid=118185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 21:08:27.484849 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.virt.hardware [None req-92f2d1a0-34d2-455b-8a15-6b4e365e7660 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Image limits 0:0:0 {{(pid=118185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 21:08:27.485195 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.virt.hardware [None req-92f2d1a0-34d2-455b-8a15-6b4e365e7660 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Flavor pref 0:0:0 {{(pid=118185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 21:08:27.485612 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.virt.hardware [None req-92f2d1a0-34d2-455b-8a15-6b4e365e7660 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Image pref 0:0:0 {{(pid=118185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 21:08:27.486115 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.virt.hardware [None req-92f2d1a0-34d2-455b-8a15-6b4e365e7660 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 21:08:27.500136 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-92f2d1a0-34d2-455b-8a15-6b4e365e7660 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:27.501054 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-92f2d1a0-34d2-455b-8a15-6b4e365e7660 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:27.502151 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-92f2d1a0-34d2-455b-8a15-6b4e365e7660 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:27.502850 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-92f2d1a0-34d2-455b-8a15-6b4e365e7660 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:27.529615 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.quota [None req-92f2d1a0-34d2-455b-8a15-6b4e365e7660 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Getting quotas for project 8e511490c0f8438fb89ac590bd63529f. Resources: {'ram', 'cores', 'instances'} {{(pid=118185) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 21:08:27.537169 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.quota [None req-92f2d1a0-34d2-455b-8a15-6b4e365e7660 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Getting quotas for user 546cd066c4244bffacbfea21f5e4f437 and project 8e511490c0f8438fb89ac590bd63529f. Resources: {'ram', 'cores', 'instances'} {{(pid=118185) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 21:08:27.631532 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-92f2d1a0-34d2-455b-8a15-6b4e365e7660 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Going to run 1 instances... {{(pid=118185) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 21:08:27.633665 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-92f2d1a0-34d2-455b-8a15-6b4e365e7660 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 92254a91-6b12-4811-a58e-e6f4cac9d965] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='62bbc2be-5003-454f-9e2a-cc350298eb61',volume_size=None,volume_type=None)] {{(pid=118185) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 21:08:28.013761 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-2bf7229f-dc84-49a9-b4f9-76e5a251b3ca tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:28.016522 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-2bf7229f-dc84-49a9-b4f9-76e5a251b3ca tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:28.038224 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2bf7229f-dc84-49a9-b4f9-76e5a251b3ca tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:28.038982 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2bf7229f-dc84-49a9-b4f9-76e5a251b3ca tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:28.039794 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2bf7229f-dc84-49a9-b4f9-76e5a251b3ca tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:28.040237 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2bf7229f-dc84-49a9-b4f9-76e5a251b3ca tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:28.332387 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-2bf7229f-dc84-49a9-b4f9-76e5a251b3ca tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:28.343786 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-2bf7229f-dc84-49a9-b4f9-76e5a251b3ca tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:28.345314 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-2bf7229f-dc84-49a9-b4f9-76e5a251b3ca tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:28.347524 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-2bf7229f-dc84-49a9-b4f9-76e5a251b3ca tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1808 microversion: 2.20 time: 0.339665 May 31 21:08:28.348438 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 303/574] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:08:28 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1808 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:08:28.842342 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-92f2d1a0-34d2-455b-8a15-6b4e365e7660 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.368994 May 31 21:08:28.843497 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 272/575] 10.222.0.55 () {60 vars in 1146 bytes} [Tue May 31 21:08:26 2022] POST /compute/v2.1/servers => generated 405 bytes in 2371 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 31 21:08:28.861424 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-c413ca61-d9d8-49bd-8f5e-1ef320712d42 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:28.862434 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-c413ca61-d9d8-49bd-8f5e-1ef320712d42 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 92254a91-6b12-4811-a58e-e6f4cac9d965] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:28.925384 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-c413ca61-d9d8-49bd-8f5e-1ef320712d42 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:28.932733 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-c413ca61-d9d8-49bd-8f5e-1ef320712d42 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965" status: 200 len: 1095 microversion: 2.1 time: 0.077055 May 31 21:08:28.933342 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 304/576] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:08:28 2022] GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965 => generated 1095 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:08:29.366073 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-fb3b1c71-3a93-425b-a9a1-cace891387ed tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:29.366674 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-fb3b1c71-3a93-425b-a9a1-cace891387ed tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:29.392644 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-fb3b1c71-3a93-425b-a9a1-cace891387ed tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:29.393223 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-fb3b1c71-3a93-425b-a9a1-cace891387ed tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:29.396024 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-fb3b1c71-3a93-425b-a9a1-cace891387ed tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:29.400511 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-fb3b1c71-3a93-425b-a9a1-cace891387ed tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:29.635739 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-fb3b1c71-3a93-425b-a9a1-cace891387ed tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:29.646998 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-fb3b1c71-3a93-425b-a9a1-cace891387ed tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:29.649344 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-fb3b1c71-3a93-425b-a9a1-cace891387ed tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:29.651019 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-fb3b1c71-3a93-425b-a9a1-cace891387ed tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1808 microversion: 2.20 time: 0.288925 May 31 21:08:29.652102 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 273/577] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:08:29 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1808 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 21:08:29.957532 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-fea2d05a-a38f-4e8b-8acb-6dfcc23227bb tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:29.960826 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-fea2d05a-a38f-4e8b-8acb-6dfcc23227bb tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 92254a91-6b12-4811-a58e-e6f4cac9d965] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:30.038557 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-fea2d05a-a38f-4e8b-8acb-6dfcc23227bb tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:30.051648 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-fea2d05a-a38f-4e8b-8acb-6dfcc23227bb tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965" status: 200 len: 1095 microversion: 2.1 time: 0.100230 May 31 21:08:30.053178 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 305/578] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:08:29 2022] GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965 => generated 1095 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:08:30.671613 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-2efb4f04-38d0-47de-be7d-888f65996292 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:30.673037 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-2efb4f04-38d0-47de-be7d-888f65996292 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:30.680973 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-2efb4f04-38d0-47de-be7d-888f65996292 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:30.681822 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-2efb4f04-38d0-47de-be7d-888f65996292 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:30.682714 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-2efb4f04-38d0-47de-be7d-888f65996292 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:30.683245 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-2efb4f04-38d0-47de-be7d-888f65996292 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:31.001011 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-2efb4f04-38d0-47de-be7d-888f65996292 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:31.017417 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-2efb4f04-38d0-47de-be7d-888f65996292 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:31.020302 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-2efb4f04-38d0-47de-be7d-888f65996292 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:31.022123 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-2efb4f04-38d0-47de-be7d-888f65996292 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1808 microversion: 2.20 time: 0.354931 May 31 21:08:31.023131 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 274/579] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:08:30 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1808 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:08:31.071730 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-57f50a9f-73b0-45c3-8550-56538b83c90f tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:31.074302 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-57f50a9f-73b0-45c3-8550-56538b83c90f tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 92254a91-6b12-4811-a58e-e6f4cac9d965] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:31.088650 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-57f50a9f-73b0-45c3-8550-56538b83c90f tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:31.090080 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-57f50a9f-73b0-45c3-8550-56538b83c90f tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:31.092263 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-57f50a9f-73b0-45c3-8550-56538b83c90f tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:31.095298 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-57f50a9f-73b0-45c3-8550-56538b83c90f tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:31.173643 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-57f50a9f-73b0-45c3-8550-56538b83c90f tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:31.181923 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-57f50a9f-73b0-45c3-8550-56538b83c90f tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965" status: 200 len: 1145 microversion: 2.1 time: 0.114850 May 31 21:08:31.182841 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 306/580] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:08:31 2022] GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965 => generated 1145 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:08:32.045358 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-c1dd732d-b4cb-4c12-a0c6-efdea0a5a581 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:32.046149 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-c1dd732d-b4cb-4c12-a0c6-efdea0a5a581 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:32.052517 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c1dd732d-b4cb-4c12-a0c6-efdea0a5a581 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:32.053089 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c1dd732d-b4cb-4c12-a0c6-efdea0a5a581 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:32.053719 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c1dd732d-b4cb-4c12-a0c6-efdea0a5a581 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:32.054193 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c1dd732d-b4cb-4c12-a0c6-efdea0a5a581 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:32.204054 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-ac5aeb46-93dc-4fc0-9b55-5002bee910a0 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:32.205840 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-ac5aeb46-93dc-4fc0-9b55-5002bee910a0 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 92254a91-6b12-4811-a58e-e6f4cac9d965] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:32.210816 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-c1dd732d-b4cb-4c12-a0c6-efdea0a5a581 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:32.213602 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ac5aeb46-93dc-4fc0-9b55-5002bee910a0 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:32.214080 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ac5aeb46-93dc-4fc0-9b55-5002bee910a0 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:32.215258 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ac5aeb46-93dc-4fc0-9b55-5002bee910a0 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:32.219468 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ac5aeb46-93dc-4fc0-9b55-5002bee910a0 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:32.221207 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-c1dd732d-b4cb-4c12-a0c6-efdea0a5a581 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:32.222797 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-c1dd732d-b4cb-4c12-a0c6-efdea0a5a581 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:32.223982 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-c1dd732d-b4cb-4c12-a0c6-efdea0a5a581 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1808 microversion: 2.20 time: 0.183246 May 31 21:08:32.224542 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 275/581] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:08:32 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1808 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:08:32.321180 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-ac5aeb46-93dc-4fc0-9b55-5002bee910a0 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:32.329685 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-ac5aeb46-93dc-4fc0-9b55-5002bee910a0 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965" status: 200 len: 1145 microversion: 2.1 time: 0.131778 May 31 21:08:32.331890 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 307/582] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:08:32 2022] GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965 => generated 1145 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:08:33.245337 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-b031120a-5b27-49a8-9823-173648ccc4ce tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:33.248012 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-b031120a-5b27-49a8-9823-173648ccc4ce tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:33.255390 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b031120a-5b27-49a8-9823-173648ccc4ce tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:33.256127 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b031120a-5b27-49a8-9823-173648ccc4ce tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:33.257196 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b031120a-5b27-49a8-9823-173648ccc4ce tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:33.258158 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b031120a-5b27-49a8-9823-173648ccc4ce tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:33.297576 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:08:33.353033 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-ea92c129-7ad9-4e16-920a-c6d8d5b48d41 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:33.355333 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-ea92c129-7ad9-4e16-920a-c6d8d5b48d41 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 92254a91-6b12-4811-a58e-e6f4cac9d965] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:33.371143 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ea92c129-7ad9-4e16-920a-c6d8d5b48d41 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:33.373125 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ea92c129-7ad9-4e16-920a-c6d8d5b48d41 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:33.374686 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ea92c129-7ad9-4e16-920a-c6d8d5b48d41 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:33.375183 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ea92c129-7ad9-4e16-920a-c6d8d5b48d41 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:33.461381 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-ea92c129-7ad9-4e16-920a-c6d8d5b48d41 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:33.471908 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-ea92c129-7ad9-4e16-920a-c6d8d5b48d41 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965" status: 200 len: 1145 microversion: 2.1 time: 0.126168 May 31 21:08:33.481857 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-b031120a-5b27-49a8-9823-173648ccc4ce tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:33.483509 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 308/583] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:08:33 2022] GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965 => generated 1145 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:08:33.492173 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-b031120a-5b27-49a8-9823-173648ccc4ce tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:33.493826 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-b031120a-5b27-49a8-9823-173648ccc4ce tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:33.495644 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-b031120a-5b27-49a8-9823-173648ccc4ce tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1808 microversion: 2.20 time: 0.256622 May 31 21:08:33.498639 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 276/584] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:08:33 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1808 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:08:34.489406 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-5df72965-eba9-4b8b-a618-8478c90d59dd tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:34.490945 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-5df72965-eba9-4b8b-a618-8478c90d59dd tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 92254a91-6b12-4811-a58e-e6f4cac9d965] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:34.498927 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5df72965-eba9-4b8b-a618-8478c90d59dd tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:34.499381 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5df72965-eba9-4b8b-a618-8478c90d59dd tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:34.500170 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5df72965-eba9-4b8b-a618-8478c90d59dd tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:34.500613 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5df72965-eba9-4b8b-a618-8478c90d59dd tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:34.520826 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-cc710eb0-72e8-499b-8889-7a81f602950a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:34.521426 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-cc710eb0-72e8-499b-8889-7a81f602950a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:34.533357 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-cc710eb0-72e8-499b-8889-7a81f602950a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:34.533811 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-cc710eb0-72e8-499b-8889-7a81f602950a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:34.557104 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-cc710eb0-72e8-499b-8889-7a81f602950a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:34.558012 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-cc710eb0-72e8-499b-8889-7a81f602950a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:34.639029 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-5df72965-eba9-4b8b-a618-8478c90d59dd tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:34.649600 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-5df72965-eba9-4b8b-a618-8478c90d59dd tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965" status: 200 len: 1145 microversion: 2.1 time: 0.161832 May 31 21:08:34.653481 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 309/585] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:08:34 2022] GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965 => generated 1145 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:08:34.796462 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-cc710eb0-72e8-499b-8889-7a81f602950a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:34.837079 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-cc710eb0-72e8-499b-8889-7a81f602950a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:34.837079 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-cc710eb0-72e8-499b-8889-7a81f602950a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:34.837079 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-cc710eb0-72e8-499b-8889-7a81f602950a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1808 microversion: 2.20 time: 0.298475 May 31 21:08:34.837435 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 277/586] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:08:34 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1808 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 21:08:35.667880 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-94b58b25-56cd-43c3-ae5a-6ce3f5875610 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:35.669872 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-94b58b25-56cd-43c3-ae5a-6ce3f5875610 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 92254a91-6b12-4811-a58e-e6f4cac9d965] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:35.677140 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-94b58b25-56cd-43c3-ae5a-6ce3f5875610 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:35.677598 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-94b58b25-56cd-43c3-ae5a-6ce3f5875610 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:35.678465 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-94b58b25-56cd-43c3-ae5a-6ce3f5875610 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:35.678913 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-94b58b25-56cd-43c3-ae5a-6ce3f5875610 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:35.772081 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-94b58b25-56cd-43c3-ae5a-6ce3f5875610 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:35.781016 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-94b58b25-56cd-43c3-ae5a-6ce3f5875610 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965" status: 200 len: 1145 microversion: 2.1 time: 0.116906 May 31 21:08:35.795209 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 310/587] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:08:35 2022] GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965 => generated 1145 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:08:35.848898 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-ab9bd18e-f993-47c1-bd9e-2582de633450 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:35.850297 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-ab9bd18e-f993-47c1-bd9e-2582de633450 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:35.852959 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:08:35.865838 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ab9bd18e-f993-47c1-bd9e-2582de633450 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:35.870277 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ab9bd18e-f993-47c1-bd9e-2582de633450 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:35.870277 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ab9bd18e-f993-47c1-bd9e-2582de633450 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:35.870277 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ab9bd18e-f993-47c1-bd9e-2582de633450 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:36.053005 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-ab9bd18e-f993-47c1-bd9e-2582de633450 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:36.068109 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-ab9bd18e-f993-47c1-bd9e-2582de633450 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:36.069765 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-ab9bd18e-f993-47c1-bd9e-2582de633450 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:36.071026 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-ab9bd18e-f993-47c1-bd9e-2582de633450 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1808 microversion: 2.20 time: 0.225926 May 31 21:08:36.075654 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 278/588] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:08:35 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1808 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:08:36.803578 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-7ecf87b1-9c9c-4303-a3bf-1f639e16745e tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:36.805324 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-7ecf87b1-9c9c-4303-a3bf-1f639e16745e tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 92254a91-6b12-4811-a58e-e6f4cac9d965] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:36.857617 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7ecf87b1-9c9c-4303-a3bf-1f639e16745e tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:36.859888 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7ecf87b1-9c9c-4303-a3bf-1f639e16745e tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:36.861105 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7ecf87b1-9c9c-4303-a3bf-1f639e16745e tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:36.865334 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7ecf87b1-9c9c-4303-a3bf-1f639e16745e tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:37.008969 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-7ecf87b1-9c9c-4303-a3bf-1f639e16745e tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:37.020008 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-7ecf87b1-9c9c-4303-a3bf-1f639e16745e tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965" status: 200 len: 1145 microversion: 2.1 time: 0.221311 May 31 21:08:37.021007 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 311/589] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:08:36 2022] GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965 => generated 1145 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:08:37.294438 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-731339db-975e-445b-8bb2-35bd91ba6d86 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:37.295093 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-731339db-975e-445b-8bb2-35bd91ba6d86 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:37.301866 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-731339db-975e-445b-8bb2-35bd91ba6d86 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:37.307982 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-731339db-975e-445b-8bb2-35bd91ba6d86 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:37.307982 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-731339db-975e-445b-8bb2-35bd91ba6d86 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:37.307982 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-731339db-975e-445b-8bb2-35bd91ba6d86 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:37.514228 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell0:SELECT=2 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:08:37.530022 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 21:08:37.530567 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Tue May 31 21:08:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd (ip 10.222.0.55) !!! May 31 21:08:37.549696 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell0:SELECT=6 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:08:37.563309 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-731339db-975e-445b-8bb2-35bd91ba6d86 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:37.574171 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-731339db-975e-445b-8bb2-35bd91ba6d86 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:37.575935 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-731339db-975e-445b-8bb2-35bd91ba6d86 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:37.577796 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-731339db-975e-445b-8bb2-35bd91ba6d86 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1808 microversion: 2.20 time: 0.485426 May 31 21:08:37.578828 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 279/590] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:08:37 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1808 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:08:38.040928 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-97ad8e0e-5204-4d73-a2ff-3dfca6a9bc47 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:38.042334 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-97ad8e0e-5204-4d73-a2ff-3dfca6a9bc47 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 92254a91-6b12-4811-a58e-e6f4cac9d965] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:38.050048 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-97ad8e0e-5204-4d73-a2ff-3dfca6a9bc47 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:38.050612 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-97ad8e0e-5204-4d73-a2ff-3dfca6a9bc47 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:38.051441 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-97ad8e0e-5204-4d73-a2ff-3dfca6a9bc47 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:38.051957 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-97ad8e0e-5204-4d73-a2ff-3dfca6a9bc47 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:38.141588 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-97ad8e0e-5204-4d73-a2ff-3dfca6a9bc47 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:38.154126 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-97ad8e0e-5204-4d73-a2ff-3dfca6a9bc47 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965" status: 200 len: 1145 microversion: 2.1 time: 0.116985 May 31 21:08:38.155335 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 312/591] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:08:38 2022] GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965 => generated 1145 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:08:38.599527 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-c3b0f314-c02f-432f-933c-bc44075929c3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:38.600837 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-c3b0f314-c02f-432f-933c-bc44075929c3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:38.609552 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c3b0f314-c02f-432f-933c-bc44075929c3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:38.610214 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c3b0f314-c02f-432f-933c-bc44075929c3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:38.611012 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c3b0f314-c02f-432f-933c-bc44075929c3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:38.611452 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c3b0f314-c02f-432f-933c-bc44075929c3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:38.757930 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-c3b0f314-c02f-432f-933c-bc44075929c3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:38.769385 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-c3b0f314-c02f-432f-933c-bc44075929c3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:38.770873 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-c3b0f314-c02f-432f-933c-bc44075929c3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:38.772149 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-c3b0f314-c02f-432f-933c-bc44075929c3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1808 microversion: 2.20 time: 0.177034 May 31 21:08:38.772723 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 280/592] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:08:38 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:08:38.956347 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-17a8eea1-9445-4c0e-aa3e-23ddd3253baf tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:08:38.957388 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-17a8eea1-9445-4c0e-aa3e-23ddd3253baf tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:38.964023 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-17a8eea1-9445-4c0e-aa3e-23ddd3253baf tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:38.964785 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-17a8eea1-9445-4c0e-aa3e-23ddd3253baf tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:38.965810 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-17a8eea1-9445-4c0e-aa3e-23ddd3253baf tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:38.966464 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-17a8eea1-9445-4c0e-aa3e-23ddd3253baf tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:39.171368 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-872fedb9-b0ac-4f76-a108-95b12df80bc8 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:39.172099 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-872fedb9-b0ac-4f76-a108-95b12df80bc8 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 92254a91-6b12-4811-a58e-e6f4cac9d965] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:39.178243 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-872fedb9-b0ac-4f76-a108-95b12df80bc8 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:39.178873 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-872fedb9-b0ac-4f76-a108-95b12df80bc8 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:39.179656 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-872fedb9-b0ac-4f76-a108-95b12df80bc8 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:39.180168 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-872fedb9-b0ac-4f76-a108-95b12df80bc8 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:39.184884 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-17a8eea1-9445-4c0e-aa3e-23ddd3253baf tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "POST /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c/action" status: 202 len: 0 microversion: 2.1 time: 0.231483 May 31 21:08:39.185882 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 313/593] 10.222.0.55 () {60 vars in 1277 bytes} [Tue May 31 21:08:38 2022] POST /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 21:08:39.193678 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-4d0a6a3d-864e-4373-91b3-b6aa707415e2 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:39.194397 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-4d0a6a3d-864e-4373-91b3-b6aa707415e2 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:39.201238 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4d0a6a3d-864e-4373-91b3-b6aa707415e2 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:39.201238 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4d0a6a3d-864e-4373-91b3-b6aa707415e2 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:39.201975 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4d0a6a3d-864e-4373-91b3-b6aa707415e2 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:39.202409 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4d0a6a3d-864e-4373-91b3-b6aa707415e2 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:39.243572 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-872fedb9-b0ac-4f76-a108-95b12df80bc8 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:39.253999 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-872fedb9-b0ac-4f76-a108-95b12df80bc8 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965" status: 200 len: 1145 microversion: 2.1 time: 0.086825 May 31 21:08:39.264340 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 281/594] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:08:39 2022] GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965 => generated 1145 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:08:39.364345 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-4d0a6a3d-864e-4373-91b3-b6aa707415e2 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:39.373435 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-4d0a6a3d-864e-4373-91b3-b6aa707415e2 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1750 microversion: 2.1 time: 0.183618 May 31 21:08:39.374041 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 314/595] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:08:39 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1750 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:08:39.791446 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-5676c70a-c141-4e8d-bafe-17afd5bf0815 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:39.792055 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-5676c70a-c141-4e8d-bafe-17afd5bf0815 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:39.799191 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-5676c70a-c141-4e8d-bafe-17afd5bf0815 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:39.799641 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-5676c70a-c141-4e8d-bafe-17afd5bf0815 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:39.800426 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-5676c70a-c141-4e8d-bafe-17afd5bf0815 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:39.800862 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-5676c70a-c141-4e8d-bafe-17afd5bf0815 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:39.943155 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-5676c70a-c141-4e8d-bafe-17afd5bf0815 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:39.952543 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-5676c70a-c141-4e8d-bafe-17afd5bf0815 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:39.954130 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-5676c70a-c141-4e8d-bafe-17afd5bf0815 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:39.955296 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-5676c70a-c141-4e8d-bafe-17afd5bf0815 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1808 microversion: 2.20 time: 0.167883 May 31 21:08:39.967134 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 282/596] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:08:39 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:08:40.291199 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-ac3f2d15-65e3-4aad-a76d-fd8b490182c1 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:40.291907 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-ac3f2d15-65e3-4aad-a76d-fd8b490182c1 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 92254a91-6b12-4811-a58e-e6f4cac9d965] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:40.295209 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell0:SELECT=4 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:08:40.300675 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ac3f2d15-65e3-4aad-a76d-fd8b490182c1 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:40.301312 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ac3f2d15-65e3-4aad-a76d-fd8b490182c1 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:40.302076 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ac3f2d15-65e3-4aad-a76d-fd8b490182c1 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:40.302705 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ac3f2d15-65e3-4aad-a76d-fd8b490182c1 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:40.370858 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-ac3f2d15-65e3-4aad-a76d-fd8b490182c1 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:40.380046 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-ac3f2d15-65e3-4aad-a76d-fd8b490182c1 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965" status: 200 len: 1145 microversion: 2.1 time: 0.110529 May 31 21:08:40.380791 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 315/597] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:08:40 2022] GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965 => generated 1145 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:08:40.395205 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-6c5f5017-dfb5-4195-91d1-350b67196338 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:40.395950 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-6c5f5017-dfb5-4195-91d1-350b67196338 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:40.403297 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-6c5f5017-dfb5-4195-91d1-350b67196338 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:40.403749 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-6c5f5017-dfb5-4195-91d1-350b67196338 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:40.404621 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-6c5f5017-dfb5-4195-91d1-350b67196338 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:40.405968 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-6c5f5017-dfb5-4195-91d1-350b67196338 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:40.569089 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-6c5f5017-dfb5-4195-91d1-350b67196338 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:40.579347 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-6c5f5017-dfb5-4195-91d1-350b67196338 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1750 microversion: 2.1 time: 0.187938 May 31 21:08:40.579347 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 283/598] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:08:40 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1750 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:08:40.974638 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-a6f966da-8989-429f-b606-58f55ec127d5 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:40.975245 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-a6f966da-8989-429f-b606-58f55ec127d5 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:40.982029 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a6f966da-8989-429f-b606-58f55ec127d5 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:40.982487 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a6f966da-8989-429f-b606-58f55ec127d5 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:40.983332 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a6f966da-8989-429f-b606-58f55ec127d5 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:40.983767 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a6f966da-8989-429f-b606-58f55ec127d5 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:41.115463 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-a6f966da-8989-429f-b606-58f55ec127d5 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:41.124435 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-a6f966da-8989-429f-b606-58f55ec127d5 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:41.125957 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-a6f966da-8989-429f-b606-58f55ec127d5 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:41.127161 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-a6f966da-8989-429f-b606-58f55ec127d5 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1808 microversion: 2.20 time: 0.156785 May 31 21:08:41.127741 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 316/599] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:08:40 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:08:41.398560 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-18185af0-26dc-4dbb-ade7-fb60dc81103d tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:41.399165 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-18185af0-26dc-4dbb-ade7-fb60dc81103d tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 92254a91-6b12-4811-a58e-e6f4cac9d965] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:41.406283 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-18185af0-26dc-4dbb-ade7-fb60dc81103d tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:41.410757 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-18185af0-26dc-4dbb-ade7-fb60dc81103d tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:41.410757 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-18185af0-26dc-4dbb-ade7-fb60dc81103d tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:41.410757 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-18185af0-26dc-4dbb-ade7-fb60dc81103d tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:41.470958 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-18185af0-26dc-4dbb-ade7-fb60dc81103d tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:41.478592 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-18185af0-26dc-4dbb-ade7-fb60dc81103d tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965" status: 200 len: 1145 microversion: 2.1 time: 0.084061 May 31 21:08:41.479154 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 284/600] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:08:41 2022] GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965 => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:08:41.597345 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-c9693bc4-26a2-4472-b7cf-6a2b42a4982c tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:41.597940 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-c9693bc4-26a2-4472-b7cf-6a2b42a4982c tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:41.604672 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c9693bc4-26a2-4472-b7cf-6a2b42a4982c tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:41.605121 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c9693bc4-26a2-4472-b7cf-6a2b42a4982c tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:41.605971 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c9693bc4-26a2-4472-b7cf-6a2b42a4982c tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:41.606470 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c9693bc4-26a2-4472-b7cf-6a2b42a4982c tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:41.763985 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-c9693bc4-26a2-4472-b7cf-6a2b42a4982c tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:41.771969 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-c9693bc4-26a2-4472-b7cf-6a2b42a4982c tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1750 microversion: 2.1 time: 0.178934 May 31 21:08:41.772532 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 317/601] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:08:41 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1750 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:08:42.147128 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-4d8a2c38-34b9-462d-b4b5-74e84880436f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:42.147628 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-4d8a2c38-34b9-462d-b4b5-74e84880436f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:42.153736 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4d8a2c38-34b9-462d-b4b5-74e84880436f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:42.154217 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4d8a2c38-34b9-462d-b4b5-74e84880436f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:42.155102 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4d8a2c38-34b9-462d-b4b5-74e84880436f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:42.155539 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4d8a2c38-34b9-462d-b4b5-74e84880436f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:42.294328 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-4d8a2c38-34b9-462d-b4b5-74e84880436f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:42.303670 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-4d8a2c38-34b9-462d-b4b5-74e84880436f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:42.305169 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-4d8a2c38-34b9-462d-b4b5-74e84880436f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:42.306383 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-4d8a2c38-34b9-462d-b4b5-74e84880436f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1808 microversion: 2.20 time: 0.163377 May 31 21:08:42.306965 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 285/602] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:08:42 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:08:42.495997 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-5c2fe2ae-c48e-4dd6-a4dc-f32d0f1acbb9 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:42.497142 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-5c2fe2ae-c48e-4dd6-a4dc-f32d0f1acbb9 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 92254a91-6b12-4811-a58e-e6f4cac9d965] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:42.503359 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5c2fe2ae-c48e-4dd6-a4dc-f32d0f1acbb9 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:42.503809 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5c2fe2ae-c48e-4dd6-a4dc-f32d0f1acbb9 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:42.504930 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5c2fe2ae-c48e-4dd6-a4dc-f32d0f1acbb9 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:42.505088 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5c2fe2ae-c48e-4dd6-a4dc-f32d0f1acbb9 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:42.564281 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-5c2fe2ae-c48e-4dd6-a4dc-f32d0f1acbb9 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:42.571795 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-5c2fe2ae-c48e-4dd6-a4dc-f32d0f1acbb9 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965" status: 200 len: 1145 microversion: 2.1 time: 0.080136 May 31 21:08:42.572360 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 318/603] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:08:42 2022] GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:08:42.791856 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-a4f3ca30-9b66-4573-bbab-a5fc2df88dba tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:42.792936 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-a4f3ca30-9b66-4573-bbab-a5fc2df88dba tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:42.804450 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a4f3ca30-9b66-4573-bbab-a5fc2df88dba tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:42.805244 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a4f3ca30-9b66-4573-bbab-a5fc2df88dba tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:42.806689 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a4f3ca30-9b66-4573-bbab-a5fc2df88dba tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:42.807463 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a4f3ca30-9b66-4573-bbab-a5fc2df88dba tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:42.963235 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-a4f3ca30-9b66-4573-bbab-a5fc2df88dba tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:42.973769 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-a4f3ca30-9b66-4573-bbab-a5fc2df88dba tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1750 microversion: 2.1 time: 0.187040 May 31 21:08:42.979109 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 286/604] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:08:42 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1750 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:08:43.327183 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-ce917ec8-cd3f-443f-97c9-1da54c680f50 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:43.328434 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-ce917ec8-cd3f-443f-97c9-1da54c680f50 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:43.335447 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ce917ec8-cd3f-443f-97c9-1da54c680f50 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:43.335899 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ce917ec8-cd3f-443f-97c9-1da54c680f50 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:43.336678 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ce917ec8-cd3f-443f-97c9-1da54c680f50 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:43.337115 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ce917ec8-cd3f-443f-97c9-1da54c680f50 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:43.561269 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-ce917ec8-cd3f-443f-97c9-1da54c680f50 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:43.569868 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-ce917ec8-cd3f-443f-97c9-1da54c680f50 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:43.571441 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-ce917ec8-cd3f-443f-97c9-1da54c680f50 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:43.572618 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-ce917ec8-cd3f-443f-97c9-1da54c680f50 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1808 microversion: 2.20 time: 0.250716 May 31 21:08:43.573170 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 319/605] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:08:43 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1808 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:08:43.590309 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-3667adc8-ec8c-4e4a-9270-77db3d60e749 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:43.590843 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-3667adc8-ec8c-4e4a-9270-77db3d60e749 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 92254a91-6b12-4811-a58e-e6f4cac9d965] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:43.597325 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-3667adc8-ec8c-4e4a-9270-77db3d60e749 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:43.597781 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-3667adc8-ec8c-4e4a-9270-77db3d60e749 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:43.598718 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-3667adc8-ec8c-4e4a-9270-77db3d60e749 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:43.599189 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-3667adc8-ec8c-4e4a-9270-77db3d60e749 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:43.663630 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-3667adc8-ec8c-4e4a-9270-77db3d60e749 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:43.671032 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-3667adc8-ec8c-4e4a-9270-77db3d60e749 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965" status: 200 len: 1145 microversion: 2.1 time: 0.084705 May 31 21:08:43.671595 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 287/606] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:08:43 2022] GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965 => generated 1145 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:08:43.991198 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-53b514e4-fff1-4c1f-876e-af196981e207 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:43.991827 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-53b514e4-fff1-4c1f-876e-af196981e207 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:43.998546 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-53b514e4-fff1-4c1f-876e-af196981e207 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:43.999024 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-53b514e4-fff1-4c1f-876e-af196981e207 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:43.999960 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-53b514e4-fff1-4c1f-876e-af196981e207 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:44.008225 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-53b514e4-fff1-4c1f-876e-af196981e207 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:44.008225 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:08:44.176966 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-53b514e4-fff1-4c1f-876e-af196981e207 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:44.185425 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-53b514e4-fff1-4c1f-876e-af196981e207 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1750 microversion: 2.1 time: 0.198009 May 31 21:08:44.186289 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 320/607] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:08:43 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1750 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:08:44.591494 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-462c641e-eba8-48ac-9794-bd2273bb66da tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:44.592101 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-462c641e-eba8-48ac-9794-bd2273bb66da tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:44.598733 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-462c641e-eba8-48ac-9794-bd2273bb66da tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:44.599186 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-462c641e-eba8-48ac-9794-bd2273bb66da tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:44.599963 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-462c641e-eba8-48ac-9794-bd2273bb66da tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:44.600419 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-462c641e-eba8-48ac-9794-bd2273bb66da tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:44.689042 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-7dd2bf3d-9da0-484d-a75a-b2bf91d878de tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:44.690834 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-7dd2bf3d-9da0-484d-a75a-b2bf91d878de tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 92254a91-6b12-4811-a58e-e6f4cac9d965] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:44.700509 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7dd2bf3d-9da0-484d-a75a-b2bf91d878de tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:44.700958 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7dd2bf3d-9da0-484d-a75a-b2bf91d878de tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:44.701731 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7dd2bf3d-9da0-484d-a75a-b2bf91d878de tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:44.702188 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7dd2bf3d-9da0-484d-a75a-b2bf91d878de tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:44.778835 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-7dd2bf3d-9da0-484d-a75a-b2bf91d878de tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:44.788517 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-462c641e-eba8-48ac-9794-bd2273bb66da tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:44.803300 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-7dd2bf3d-9da0-484d-a75a-b2bf91d878de tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965" status: 200 len: 1145 microversion: 2.1 time: 0.118701 May 31 21:08:44.804411 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 321/608] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:08:44 2022] GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965 => generated 1145 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:08:44.813415 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-462c641e-eba8-48ac-9794-bd2273bb66da tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:44.813415 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-462c641e-eba8-48ac-9794-bd2273bb66da tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:44.813415 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-462c641e-eba8-48ac-9794-bd2273bb66da tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1808 microversion: 2.20 time: 0.224018 May 31 21:08:44.814069 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 288/609] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:08:44 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1808 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:08:45.206751 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-a14474aa-2fe4-4c3b-9792-c41747aaf0aa tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:45.207697 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-a14474aa-2fe4-4c3b-9792-c41747aaf0aa tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:45.217838 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a14474aa-2fe4-4c3b-9792-c41747aaf0aa tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:45.218608 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a14474aa-2fe4-4c3b-9792-c41747aaf0aa tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:45.219895 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a14474aa-2fe4-4c3b-9792-c41747aaf0aa tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:45.220562 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a14474aa-2fe4-4c3b-9792-c41747aaf0aa tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:45.401692 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-a14474aa-2fe4-4c3b-9792-c41747aaf0aa tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:45.419770 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-a14474aa-2fe4-4c3b-9792-c41747aaf0aa tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1750 microversion: 2.1 time: 0.218165 May 31 21:08:45.420999 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 289/610] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:08:45 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1750 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:08:45.830250 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-c8e322c7-96c5-4046-9758-2b6b291f4694 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:45.831143 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-c8e322c7-96c5-4046-9758-2b6b291f4694 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 92254a91-6b12-4811-a58e-e6f4cac9d965] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:45.838395 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c8e322c7-96c5-4046-9758-2b6b291f4694 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:45.838856 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c8e322c7-96c5-4046-9758-2b6b291f4694 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:45.839645 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c8e322c7-96c5-4046-9758-2b6b291f4694 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:45.840090 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c8e322c7-96c5-4046-9758-2b6b291f4694 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:45.845341 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-03a0424f-f27d-4406-912f-8351135085e2 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:45.848952 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-03a0424f-f27d-4406-912f-8351135085e2 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:45.863717 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-03a0424f-f27d-4406-912f-8351135085e2 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:45.864641 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-03a0424f-f27d-4406-912f-8351135085e2 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:45.865940 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-03a0424f-f27d-4406-912f-8351135085e2 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:45.866740 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-03a0424f-f27d-4406-912f-8351135085e2 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:45.922423 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-c8e322c7-96c5-4046-9758-2b6b291f4694 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:45.931346 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-c8e322c7-96c5-4046-9758-2b6b291f4694 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965" status: 200 len: 1137 microversion: 2.1 time: 0.105149 May 31 21:08:45.932031 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 322/611] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:08:45 2022] GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965 => generated 1137 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:08:46.121353 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-03a0424f-f27d-4406-912f-8351135085e2 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:46.134371 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-03a0424f-f27d-4406-912f-8351135085e2 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:46.136897 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-03a0424f-f27d-4406-912f-8351135085e2 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:46.139590 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-03a0424f-f27d-4406-912f-8351135085e2 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1808 microversion: 2.20 time: 0.305295 May 31 21:08:46.140478 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 290/612] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:08:45 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1808 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:08:46.447018 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-9c929816-76a6-4847-9005-410c29349bb0 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:46.448285 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-9c929816-76a6-4847-9005-410c29349bb0 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:46.457020 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-9c929816-76a6-4847-9005-410c29349bb0 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:46.457772 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-9c929816-76a6-4847-9005-410c29349bb0 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:46.459348 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-9c929816-76a6-4847-9005-410c29349bb0 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:46.460026 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-9c929816-76a6-4847-9005-410c29349bb0 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:46.666013 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-9c929816-76a6-4847-9005-410c29349bb0 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:46.674780 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-9c929816-76a6-4847-9005-410c29349bb0 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1750 microversion: 2.1 time: 0.232938 May 31 21:08:46.686122 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 323/613] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:08:46 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1750 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:08:46.952954 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-6e736b7c-c102-4a85-b355-ca418369a114 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:46.953655 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-6e736b7c-c102-4a85-b355-ca418369a114 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 92254a91-6b12-4811-a58e-e6f4cac9d965] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:46.961172 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-6e736b7c-c102-4a85-b355-ca418369a114 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:46.961711 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-6e736b7c-c102-4a85-b355-ca418369a114 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:46.962612 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-6e736b7c-c102-4a85-b355-ca418369a114 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:46.963126 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-6e736b7c-c102-4a85-b355-ca418369a114 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:47.044587 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-6e736b7c-c102-4a85-b355-ca418369a114 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:47.052638 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-6e736b7c-c102-4a85-b355-ca418369a114 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965" status: 200 len: 1211 microversion: 2.1 time: 0.104113 May 31 21:08:47.053214 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 291/614] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:08:46 2022] GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965 => generated 1211 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:08:47.159221 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-bad97f49-c09d-4546-bd34-f6491826271e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:47.159880 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-bad97f49-c09d-4546-bd34-f6491826271e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:47.166869 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-bad97f49-c09d-4546-bd34-f6491826271e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:47.167232 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-bad97f49-c09d-4546-bd34-f6491826271e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:47.168028 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-bad97f49-c09d-4546-bd34-f6491826271e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:47.169042 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-bad97f49-c09d-4546-bd34-f6491826271e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:47.325271 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-bad97f49-c09d-4546-bd34-f6491826271e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:47.337857 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-bad97f49-c09d-4546-bd34-f6491826271e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:47.339465 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-bad97f49-c09d-4546-bd34-f6491826271e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:47.341400 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-bad97f49-c09d-4546-bd34-f6491826271e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1808 microversion: 2.20 time: 0.186268 May 31 21:08:47.342413 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 324/615] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:08:47 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1808 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:08:47.693993 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-c6ab89bd-6a9b-4059-be58-6559dfde8eed tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:47.698162 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-c6ab89bd-6a9b-4059-be58-6559dfde8eed tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:47.702189 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c6ab89bd-6a9b-4059-be58-6559dfde8eed tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:47.703060 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c6ab89bd-6a9b-4059-be58-6559dfde8eed tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:47.703879 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c6ab89bd-6a9b-4059-be58-6559dfde8eed tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:47.704418 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c6ab89bd-6a9b-4059-be58-6559dfde8eed tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:47.865714 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-c6ab89bd-6a9b-4059-be58-6559dfde8eed tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:47.875701 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-c6ab89bd-6a9b-4059-be58-6559dfde8eed tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1755 microversion: 2.1 time: 0.185812 May 31 21:08:47.876316 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 292/616] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:08:47 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1755 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:08:48.069645 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-2ab7fa62-8935-4930-8dd3-7b5cfc1ac090 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:48.070410 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-2ab7fa62-8935-4930-8dd3-7b5cfc1ac090 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 92254a91-6b12-4811-a58e-e6f4cac9d965] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:48.076761 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2ab7fa62-8935-4930-8dd3-7b5cfc1ac090 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:48.077217 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2ab7fa62-8935-4930-8dd3-7b5cfc1ac090 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:48.078032 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2ab7fa62-8935-4930-8dd3-7b5cfc1ac090 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:48.078473 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2ab7fa62-8935-4930-8dd3-7b5cfc1ac090 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:48.235815 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-2ab7fa62-8935-4930-8dd3-7b5cfc1ac090 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:48.245566 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-2ab7fa62-8935-4930-8dd3-7b5cfc1ac090 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965" status: 200 len: 1278 microversion: 2.1 time: 0.179648 May 31 21:08:48.246261 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 325/617] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:08:48 2022] GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965 => generated 1278 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:08:48.360444 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-faf14b0a-e783-4361-b40c-f0287807c3f4 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:48.361777 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-faf14b0a-e783-4361-b40c-f0287807c3f4 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:48.368749 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-faf14b0a-e783-4361-b40c-f0287807c3f4 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:48.369211 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-faf14b0a-e783-4361-b40c-f0287807c3f4 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:48.370269 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-faf14b0a-e783-4361-b40c-f0287807c3f4 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:48.370721 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-faf14b0a-e783-4361-b40c-f0287807c3f4 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:48.375753 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell1:SELECT=100 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:08:48.566952 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-faf14b0a-e783-4361-b40c-f0287807c3f4 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:48.576486 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-faf14b0a-e783-4361-b40c-f0287807c3f4 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:48.578087 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-faf14b0a-e783-4361-b40c-f0287807c3f4 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:48.579269 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-faf14b0a-e783-4361-b40c-f0287807c3f4 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1808 microversion: 2.20 time: 0.223585 May 31 21:08:48.579827 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 293/618] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:08:48 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1808 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:08:48.897003 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-209dc3d2-9c3b-4ff8-b109-52d4aa65ef3f tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:48.898112 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-209dc3d2-9c3b-4ff8-b109-52d4aa65ef3f tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:48.909855 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-209dc3d2-9c3b-4ff8-b109-52d4aa65ef3f tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:48.910711 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-209dc3d2-9c3b-4ff8-b109-52d4aa65ef3f tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:48.913398 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-209dc3d2-9c3b-4ff8-b109-52d4aa65ef3f tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:48.914152 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-209dc3d2-9c3b-4ff8-b109-52d4aa65ef3f tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:49.081028 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [req-21495eef-260b-44c0-bf5a-54f7a3a2aa71 req-802e21af-7a8a-4764-8cc9-6fdd432c0552 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92254a91-6b12-4811-a58e-e6f4cac9d965", "tag": "184f337b-0888-4e33-981f-ff3bb1208077"}]} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:08:49.091397 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-21495eef-260b-44c0-bf5a-54f7a3a2aa71 req-802e21af-7a8a-4764-8cc9-6fdd432c0552 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:49.091780 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-21495eef-260b-44c0-bf5a-54f7a3a2aa71 req-802e21af-7a8a-4764-8cc9-6fdd432c0552 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:49.109533 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.compute.server_external_events [req-21495eef-260b-44c0-bf5a-54f7a3a2aa71 req-802e21af-7a8a-4764-8cc9-6fdd432c0552 service nova] Creating event network-changed:184f337b-0888-4e33-981f-ff3bb1208077 for instance 92254a91-6b12-4811-a58e-e6f4cac9d965 on hv-cinder-83979 May 31 21:08:49.117167 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [req-21495eef-260b-44c0-bf5a-54f7a3a2aa71 req-802e21af-7a8a-4764-8cc9-6fdd432c0552 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039486 May 31 21:08:49.125017 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 294/619] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:08:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:08:49.180438 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-209dc3d2-9c3b-4ff8-b109-52d4aa65ef3f tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:49.193510 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-209dc3d2-9c3b-4ff8-b109-52d4aa65ef3f tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1755 microversion: 2.1 time: 0.303223 May 31 21:08:49.194439 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 326/620] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:08:48 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1755 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:08:49.272227 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-d0e6fb70-be2e-49c4-b3fc-d998eccb3046 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:49.274108 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-d0e6fb70-be2e-49c4-b3fc-d998eccb3046 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 92254a91-6b12-4811-a58e-e6f4cac9d965] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:49.283684 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-d0e6fb70-be2e-49c4-b3fc-d998eccb3046 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:49.284150 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-d0e6fb70-be2e-49c4-b3fc-d998eccb3046 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:49.284960 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-d0e6fb70-be2e-49c4-b3fc-d998eccb3046 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:49.285409 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-d0e6fb70-be2e-49c4-b3fc-d998eccb3046 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:49.474215 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-d0e6fb70-be2e-49c4-b3fc-d998eccb3046 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:49.487596 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-d0e6fb70-be2e-49c4-b3fc-d998eccb3046 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965" status: 200 len: 1266 microversion: 2.1 time: 0.223071 May 31 21:08:49.488757 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 295/621] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:08:49 2022] GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965 => generated 1266 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:08:49.598340 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-2e5f7cd9-65e0-46dd-a36c-c791b13a274b tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:49.598977 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-2e5f7cd9-65e0-46dd-a36c-c791b13a274b tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:49.607668 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2e5f7cd9-65e0-46dd-a36c-c791b13a274b tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:49.608120 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2e5f7cd9-65e0-46dd-a36c-c791b13a274b tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:49.609019 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2e5f7cd9-65e0-46dd-a36c-c791b13a274b tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:49.609612 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2e5f7cd9-65e0-46dd-a36c-c791b13a274b tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:49.792792 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-2e5f7cd9-65e0-46dd-a36c-c791b13a274b tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:49.805861 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-2e5f7cd9-65e0-46dd-a36c-c791b13a274b tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:49.807694 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-2e5f7cd9-65e0-46dd-a36c-c791b13a274b tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:49.809975 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-2e5f7cd9-65e0-46dd-a36c-c791b13a274b tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1808 microversion: 2.20 time: 0.214708 May 31 21:08:49.811644 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 327/622] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:08:49 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1808 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:08:50.218271 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-f6172ee2-6b02-460f-bb7d-6439c5f6083d tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:50.218888 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-f6172ee2-6b02-460f-bb7d-6439c5f6083d tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:50.226890 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f6172ee2-6b02-460f-bb7d-6439c5f6083d tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:50.227450 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f6172ee2-6b02-460f-bb7d-6439c5f6083d tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:50.228421 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f6172ee2-6b02-460f-bb7d-6439c5f6083d tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:50.228896 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f6172ee2-6b02-460f-bb7d-6439c5f6083d tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:50.405508 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-f6172ee2-6b02-460f-bb7d-6439c5f6083d tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:50.418786 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-f6172ee2-6b02-460f-bb7d-6439c5f6083d tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1755 microversion: 2.1 time: 0.204373 May 31 21:08:50.419749 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 296/623] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:08:50 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1755 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:08:50.506496 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-59e94b1b-6541-4517-a15f-26b703ee59f0 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:50.507115 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-59e94b1b-6541-4517-a15f-26b703ee59f0 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 92254a91-6b12-4811-a58e-e6f4cac9d965] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:50.519637 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-59e94b1b-6541-4517-a15f-26b703ee59f0 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:50.520089 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-59e94b1b-6541-4517-a15f-26b703ee59f0 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:50.520877 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-59e94b1b-6541-4517-a15f-26b703ee59f0 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:50.521315 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-59e94b1b-6541-4517-a15f-26b703ee59f0 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:50.668054 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-59e94b1b-6541-4517-a15f-26b703ee59f0 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:50.676476 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-59e94b1b-6541-4517-a15f-26b703ee59f0 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965" status: 200 len: 1266 microversion: 2.1 time: 0.174061 May 31 21:08:50.677079 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 328/624] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:08:50 2022] GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:08:50.829630 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-1fb323b3-cfe5-491c-9b89-1e991f4c5f66 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:50.830419 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-1fb323b3-cfe5-491c-9b89-1e991f4c5f66 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:50.836976 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-1fb323b3-cfe5-491c-9b89-1e991f4c5f66 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:50.837428 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-1fb323b3-cfe5-491c-9b89-1e991f4c5f66 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:50.838248 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-1fb323b3-cfe5-491c-9b89-1e991f4c5f66 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:50.838684 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-1fb323b3-cfe5-491c-9b89-1e991f4c5f66 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:50.980423 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-1fb323b3-cfe5-491c-9b89-1e991f4c5f66 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:50.989570 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-1fb323b3-cfe5-491c-9b89-1e991f4c5f66 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:50.991112 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-1fb323b3-cfe5-491c-9b89-1e991f4c5f66 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:51.004096 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-1fb323b3-cfe5-491c-9b89-1e991f4c5f66 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1808 microversion: 2.20 time: 0.167286 May 31 21:08:51.004096 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 297/625] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:08:50 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:08:51.442264 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-7f9e9c2f-fc35-41a0-93b7-7076210057e4 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:51.442970 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-7f9e9c2f-fc35-41a0-93b7-7076210057e4 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:51.451168 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7f9e9c2f-fc35-41a0-93b7-7076210057e4 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:51.451619 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7f9e9c2f-fc35-41a0-93b7-7076210057e4 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:51.452396 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7f9e9c2f-fc35-41a0-93b7-7076210057e4 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:51.452832 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7f9e9c2f-fc35-41a0-93b7-7076210057e4 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:51.634600 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-7f9e9c2f-fc35-41a0-93b7-7076210057e4 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:51.644383 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-7f9e9c2f-fc35-41a0-93b7-7076210057e4 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1755 microversion: 2.1 time: 0.206805 May 31 21:08:51.644973 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 329/626] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:08:51 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1755 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:08:51.695000 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-7d84b27c-231e-4a07-b00a-947b7983a5e3 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:51.695700 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-7d84b27c-231e-4a07-b00a-947b7983a5e3 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 92254a91-6b12-4811-a58e-e6f4cac9d965] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:51.703941 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-7d84b27c-231e-4a07-b00a-947b7983a5e3 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:51.704391 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-7d84b27c-231e-4a07-b00a-947b7983a5e3 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:51.705171 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-7d84b27c-231e-4a07-b00a-947b7983a5e3 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:51.705607 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-7d84b27c-231e-4a07-b00a-947b7983a5e3 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:51.857691 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-7d84b27c-231e-4a07-b00a-947b7983a5e3 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:51.865742 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-7d84b27c-231e-4a07-b00a-947b7983a5e3 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965" status: 200 len: 1266 microversion: 2.1 time: 0.175771 May 31 21:08:51.866382 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 298/627] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:08:51 2022] GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:08:52.021710 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-e798ab7d-ce7a-4fc6-8807-e0a1128b2985 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:52.022838 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-e798ab7d-ce7a-4fc6-8807-e0a1128b2985 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:52.030283 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e798ab7d-ce7a-4fc6-8807-e0a1128b2985 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:52.030735 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e798ab7d-ce7a-4fc6-8807-e0a1128b2985 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:52.031517 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e798ab7d-ce7a-4fc6-8807-e0a1128b2985 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:52.031952 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e798ab7d-ce7a-4fc6-8807-e0a1128b2985 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:52.181035 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-e798ab7d-ce7a-4fc6-8807-e0a1128b2985 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:52.190911 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-e798ab7d-ce7a-4fc6-8807-e0a1128b2985 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:52.192438 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-e798ab7d-ce7a-4fc6-8807-e0a1128b2985 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:52.193626 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-e798ab7d-ce7a-4fc6-8807-e0a1128b2985 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1808 microversion: 2.20 time: 0.176721 May 31 21:08:52.194363 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 330/628] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:08:52 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:08:52.672481 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-3d759df0-618a-4011-a096-06f92335e930 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:52.673443 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-3d759df0-618a-4011-a096-06f92335e930 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:52.682852 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-3d759df0-618a-4011-a096-06f92335e930 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:52.683584 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-3d759df0-618a-4011-a096-06f92335e930 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:52.685405 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-3d759df0-618a-4011-a096-06f92335e930 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:52.686161 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-3d759df0-618a-4011-a096-06f92335e930 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:52.875062 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-3d759df0-618a-4011-a096-06f92335e930 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:52.883501 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-6a4813ca-6e59-4dac-8adb-906bc2d807f6 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:52.884469 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-6a4813ca-6e59-4dac-8adb-906bc2d807f6 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 92254a91-6b12-4811-a58e-e6f4cac9d965] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:52.891076 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-3d759df0-618a-4011-a096-06f92335e930 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1755 microversion: 2.1 time: 0.225672 May 31 21:08:52.891694 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 299/629] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:08:52 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1755 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:08:52.892048 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6a4813ca-6e59-4dac-8adb-906bc2d807f6 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:52.892574 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6a4813ca-6e59-4dac-8adb-906bc2d807f6 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:52.893435 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6a4813ca-6e59-4dac-8adb-906bc2d807f6 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:52.893964 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6a4813ca-6e59-4dac-8adb-906bc2d807f6 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:53.066481 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-6a4813ca-6e59-4dac-8adb-906bc2d807f6 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:53.074306 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-6a4813ca-6e59-4dac-8adb-906bc2d807f6 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965" status: 200 len: 1266 microversion: 2.1 time: 0.194589 May 31 21:08:53.076539 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 331/630] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:08:52 2022] GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965 => generated 1266 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:08:53.214056 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-b15119f4-1feb-4178-be93-fe1c2c4dc048 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:53.214725 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-b15119f4-1feb-4178-be93-fe1c2c4dc048 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:53.222120 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b15119f4-1feb-4178-be93-fe1c2c4dc048 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:53.222685 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b15119f4-1feb-4178-be93-fe1c2c4dc048 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:53.223617 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b15119f4-1feb-4178-be93-fe1c2c4dc048 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:53.224060 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b15119f4-1feb-4178-be93-fe1c2c4dc048 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:53.379570 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-b15119f4-1feb-4178-be93-fe1c2c4dc048 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:53.394480 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-b15119f4-1feb-4178-be93-fe1c2c4dc048 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:53.397721 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-b15119f4-1feb-4178-be93-fe1c2c4dc048 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:53.400410 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-b15119f4-1feb-4178-be93-fe1c2c4dc048 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1808 microversion: 2.20 time: 0.191141 May 31 21:08:53.401485 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 300/631] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:08:53 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1808 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:08:53.927929 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-99275df2-1f5a-4c95-9ee9-e6a9952eca3e tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:53.927929 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-99275df2-1f5a-4c95-9ee9-e6a9952eca3e tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:53.927929 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_api:SELECT=68 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:08:53.927929 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-99275df2-1f5a-4c95-9ee9-e6a9952eca3e tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:53.927929 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-99275df2-1f5a-4c95-9ee9-e6a9952eca3e tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:53.928462 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-99275df2-1f5a-4c95-9ee9-e6a9952eca3e tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:53.928462 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-99275df2-1f5a-4c95-9ee9-e6a9952eca3e tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:54.094270 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-db73c3b4-8ef0-4a75-828b-d263eb850ba0 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:54.095589 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-db73c3b4-8ef0-4a75-828b-d263eb850ba0 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 92254a91-6b12-4811-a58e-e6f4cac9d965] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:54.104678 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-db73c3b4-8ef0-4a75-828b-d263eb850ba0 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:54.105129 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-db73c3b4-8ef0-4a75-828b-d263eb850ba0 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:54.106510 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-db73c3b4-8ef0-4a75-828b-d263eb850ba0 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:54.106957 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-db73c3b4-8ef0-4a75-828b-d263eb850ba0 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:54.110528 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-99275df2-1f5a-4c95-9ee9-e6a9952eca3e tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:54.126550 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-99275df2-1f5a-4c95-9ee9-e6a9952eca3e tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1755 microversion: 2.1 time: 0.213164 May 31 21:08:54.128173 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 332/632] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:08:53 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1755 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:08:54.304052 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-db73c3b4-8ef0-4a75-828b-d263eb850ba0 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:54.312940 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-db73c3b4-8ef0-4a75-828b-d263eb850ba0 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965" status: 200 len: 1266 microversion: 2.1 time: 0.224373 May 31 21:08:54.313536 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 301/633] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:08:54 2022] GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965 => generated 1266 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:08:54.428328 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-ced15cf5-fcbe-4c58-b9c0-c549c7fe4bc0 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:54.429048 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-ced15cf5-fcbe-4c58-b9c0-c549c7fe4bc0 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:54.437638 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ced15cf5-fcbe-4c58-b9c0-c549c7fe4bc0 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:54.438425 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ced15cf5-fcbe-4c58-b9c0-c549c7fe4bc0 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:54.439843 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ced15cf5-fcbe-4c58-b9c0-c549c7fe4bc0 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:54.440688 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ced15cf5-fcbe-4c58-b9c0-c549c7fe4bc0 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:54.628201 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-ced15cf5-fcbe-4c58-b9c0-c549c7fe4bc0 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:54.641000 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-ced15cf5-fcbe-4c58-b9c0-c549c7fe4bc0 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:54.642576 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-ced15cf5-fcbe-4c58-b9c0-c549c7fe4bc0 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:54.643757 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-ced15cf5-fcbe-4c58-b9c0-c549c7fe4bc0 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1808 microversion: 2.20 time: 0.219445 May 31 21:08:54.644314 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 333/634] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:08:54 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1808 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 21:08:55.150994 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-14c86af5-8e96-438e-9d46-8132a35dd2c7 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:55.151570 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-14c86af5-8e96-438e-9d46-8132a35dd2c7 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:55.159048 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-14c86af5-8e96-438e-9d46-8132a35dd2c7 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:55.160082 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-14c86af5-8e96-438e-9d46-8132a35dd2c7 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:55.161453 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-14c86af5-8e96-438e-9d46-8132a35dd2c7 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:55.162468 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-14c86af5-8e96-438e-9d46-8132a35dd2c7 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:55.330281 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-c7f70b85-0f8c-42bb-90f4-c0beb0b3192b tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:55.331092 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-c7f70b85-0f8c-42bb-90f4-c0beb0b3192b tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 92254a91-6b12-4811-a58e-e6f4cac9d965] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:55.338061 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c7f70b85-0f8c-42bb-90f4-c0beb0b3192b tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:55.338816 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c7f70b85-0f8c-42bb-90f4-c0beb0b3192b tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:55.339605 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c7f70b85-0f8c-42bb-90f4-c0beb0b3192b tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:55.340067 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c7f70b85-0f8c-42bb-90f4-c0beb0b3192b tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:55.359989 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-14c86af5-8e96-438e-9d46-8132a35dd2c7 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:55.374730 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-14c86af5-8e96-438e-9d46-8132a35dd2c7 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1755 microversion: 2.1 time: 0.228898 May 31 21:08:55.375889 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 302/635] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:08:55 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1755 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:08:55.486270 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-c7f70b85-0f8c-42bb-90f4-c0beb0b3192b tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:55.495252 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-c7f70b85-0f8c-42bb-90f4-c0beb0b3192b tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965" status: 200 len: 1266 microversion: 2.1 time: 0.169279 May 31 21:08:55.496015 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 334/636] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:08:55 2022] GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:08:55.666431 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-675debab-757b-4921-8acb-6d30080ef2fb tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:55.667052 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-675debab-757b-4921-8acb-6d30080ef2fb tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:55.675205 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-675debab-757b-4921-8acb-6d30080ef2fb tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:55.675647 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-675debab-757b-4921-8acb-6d30080ef2fb tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:55.676605 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-675debab-757b-4921-8acb-6d30080ef2fb tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:55.677054 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-675debab-757b-4921-8acb-6d30080ef2fb tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:55.849287 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-675debab-757b-4921-8acb-6d30080ef2fb tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:55.860121 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-675debab-757b-4921-8acb-6d30080ef2fb tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:55.862233 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-675debab-757b-4921-8acb-6d30080ef2fb tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:55.863513 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-675debab-757b-4921-8acb-6d30080ef2fb tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1808 microversion: 2.20 time: 0.200903 May 31 21:08:55.864534 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 303/637] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:08:55 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1808 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 21:08:56.024430 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [req-b71a586b-b599-43c1-a1bc-bb449a0f4359 req-b60d2007-194c-4c94-b7be-5d7c4a527a05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a123764b-4693-41b1-bad8-a1a63cc951cd", "name": "network-vif-plugged", "status": "completed", "tag": "cc0edf95-fc02-451a-b38f-075bee275ed6"}]} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:08:56.034855 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-b71a586b-b599-43c1-a1bc-bb449a0f4359 req-b60d2007-194c-4c94-b7be-5d7c4a527a05 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:56.035140 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-b71a586b-b599-43c1-a1bc-bb449a0f4359 req-b60d2007-194c-4c94-b7be-5d7c4a527a05 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:56.047735 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.compute.server_external_events [req-b71a586b-b599-43c1-a1bc-bb449a0f4359 req-b60d2007-194c-4c94-b7be-5d7c4a527a05 service nova] Creating event network-vif-plugged:cc0edf95-fc02-451a-b38f-075bee275ed6 for instance a123764b-4693-41b1-bad8-a1a63cc951cd on hv-cinder-83979 May 31 21:08:56.053411 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [req-b71a586b-b599-43c1-a1bc-bb449a0f4359 req-b60d2007-194c-4c94-b7be-5d7c4a527a05 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032776 May 31 21:08:56.054073 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 335/638] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:08:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:08:56.394676 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-7cc7fe44-55f5-4a8d-a596-ae0d1f5561de tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:56.395494 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-7cc7fe44-55f5-4a8d-a596-ae0d1f5561de tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:56.406583 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-7cc7fe44-55f5-4a8d-a596-ae0d1f5561de tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:56.407030 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-7cc7fe44-55f5-4a8d-a596-ae0d1f5561de tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:56.407805 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-7cc7fe44-55f5-4a8d-a596-ae0d1f5561de tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:56.408235 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-7cc7fe44-55f5-4a8d-a596-ae0d1f5561de tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:56.515149 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-2d7993d7-c62e-49ce-acd6-aebcf00f5ec5 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:56.516530 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-2d7993d7-c62e-49ce-acd6-aebcf00f5ec5 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 92254a91-6b12-4811-a58e-e6f4cac9d965] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:56.524857 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2d7993d7-c62e-49ce-acd6-aebcf00f5ec5 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:56.525315 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2d7993d7-c62e-49ce-acd6-aebcf00f5ec5 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:56.526200 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2d7993d7-c62e-49ce-acd6-aebcf00f5ec5 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:56.526642 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2d7993d7-c62e-49ce-acd6-aebcf00f5ec5 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:56.572658 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-7cc7fe44-55f5-4a8d-a596-ae0d1f5561de tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:56.583015 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-7cc7fe44-55f5-4a8d-a596-ae0d1f5561de tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1755 microversion: 2.1 time: 0.193660 May 31 21:08:56.638094 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 304/639] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:08:56 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1755 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:08:56.680122 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-2d7993d7-c62e-49ce-acd6-aebcf00f5ec5 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:56.688213 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-2d7993d7-c62e-49ce-acd6-aebcf00f5ec5 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965" status: 200 len: 1266 microversion: 2.1 time: 0.179109 May 31 21:08:56.688784 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 336/640] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:08:56 2022] GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965 => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:08:56.881859 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-6d873085-e564-4236-8fe0-e42985c2e884 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:56.882533 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-6d873085-e564-4236-8fe0-e42985c2e884 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:56.889103 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-6d873085-e564-4236-8fe0-e42985c2e884 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:56.889658 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-6d873085-e564-4236-8fe0-e42985c2e884 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:56.890376 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-6d873085-e564-4236-8fe0-e42985c2e884 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:56.890813 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-6d873085-e564-4236-8fe0-e42985c2e884 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:57.025077 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-6d873085-e564-4236-8fe0-e42985c2e884 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:57.034732 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-6d873085-e564-4236-8fe0-e42985c2e884 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:57.035963 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-6d873085-e564-4236-8fe0-e42985c2e884 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:57.037111 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-6d873085-e564-4236-8fe0-e42985c2e884 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1808 microversion: 2.20 time: 0.159184 May 31 21:08:57.037670 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 305/641] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:08:56 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:08:57.605968 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-ee7c0150-41b8-407a-a57a-040cc00327e5 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:57.607635 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-ee7c0150-41b8-407a-a57a-040cc00327e5 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:57.614246 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ee7c0150-41b8-407a-a57a-040cc00327e5 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:57.614695 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ee7c0150-41b8-407a-a57a-040cc00327e5 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:57.615477 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ee7c0150-41b8-407a-a57a-040cc00327e5 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:57.615913 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ee7c0150-41b8-407a-a57a-040cc00327e5 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:57.636019 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell1:SELECT=100 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:08:57.706964 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-a80b4791-0700-4c55-87fe-4352d622cae8 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:57.708697 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-a80b4791-0700-4c55-87fe-4352d622cae8 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 92254a91-6b12-4811-a58e-e6f4cac9d965] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:57.717576 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a80b4791-0700-4c55-87fe-4352d622cae8 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:57.718088 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a80b4791-0700-4c55-87fe-4352d622cae8 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:57.718954 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a80b4791-0700-4c55-87fe-4352d622cae8 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:57.719650 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a80b4791-0700-4c55-87fe-4352d622cae8 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:57.844753 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-ee7c0150-41b8-407a-a57a-040cc00327e5 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:57.853034 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-ee7c0150-41b8-407a-a57a-040cc00327e5 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1755 microversion: 2.1 time: 0.251603 May 31 21:08:57.853855 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 337/642] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:08:57 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1755 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:08:57.941521 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-a80b4791-0700-4c55-87fe-4352d622cae8 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:57.950341 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-a80b4791-0700-4c55-87fe-4352d622cae8 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965" status: 200 len: 1266 microversion: 2.1 time: 0.247272 May 31 21:08:57.950934 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 306/643] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:08:57 2022] GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965 => generated 1266 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:08:58.055631 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-92683c0a-6180-4ad3-a5ce-a65ab3e633d4 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:58.056232 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-92683c0a-6180-4ad3-a5ce-a65ab3e633d4 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:58.063704 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-92683c0a-6180-4ad3-a5ce-a65ab3e633d4 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:58.064098 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-92683c0a-6180-4ad3-a5ce-a65ab3e633d4 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:58.064885 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-92683c0a-6180-4ad3-a5ce-a65ab3e633d4 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:58.065319 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-92683c0a-6180-4ad3-a5ce-a65ab3e633d4 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:58.240401 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-92683c0a-6180-4ad3-a5ce-a65ab3e633d4 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:58.249577 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-92683c0a-6180-4ad3-a5ce-a65ab3e633d4 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:58.251196 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-92683c0a-6180-4ad3-a5ce-a65ab3e633d4 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:58.252495 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-92683c0a-6180-4ad3-a5ce-a65ab3e633d4 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1808 microversion: 2.20 time: 0.200781 May 31 21:08:58.253543 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 338/644] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:08:58 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1808 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:08:58.877222 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-5b25d83e-faef-4146-b670-4fcb70f764b6 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:58.877872 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-5b25d83e-faef-4146-b670-4fcb70f764b6 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:58.884569 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-5b25d83e-faef-4146-b670-4fcb70f764b6 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:58.885028 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-5b25d83e-faef-4146-b670-4fcb70f764b6 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:58.885852 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-5b25d83e-faef-4146-b670-4fcb70f764b6 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:58.886492 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-5b25d83e-faef-4146-b670-4fcb70f764b6 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:58.971034 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-39ac7aa8-9ec1-4e3d-8040-de8fc581d318 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:58.971808 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-39ac7aa8-9ec1-4e3d-8040-de8fc581d318 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 92254a91-6b12-4811-a58e-e6f4cac9d965] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:58.979209 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-39ac7aa8-9ec1-4e3d-8040-de8fc581d318 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:58.979741 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-39ac7aa8-9ec1-4e3d-8040-de8fc581d318 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:58.980595 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-39ac7aa8-9ec1-4e3d-8040-de8fc581d318 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:58.981728 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-39ac7aa8-9ec1-4e3d-8040-de8fc581d318 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:59.136583 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-5b25d83e-faef-4146-b670-4fcb70f764b6 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:59.148874 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-5b25d83e-faef-4146-b670-4fcb70f764b6 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1755 microversion: 2.1 time: 0.275465 May 31 21:08:59.149587 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 307/645] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:08:58 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1755 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:08:59.182671 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-39ac7aa8-9ec1-4e3d-8040-de8fc581d318 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:59.191677 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-39ac7aa8-9ec1-4e3d-8040-de8fc581d318 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965" status: 200 len: 1266 microversion: 2.1 time: 0.226208 May 31 21:08:59.192299 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 339/646] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:08:58 2022] GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965 => generated 1266 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:08:59.271621 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-58125f35-b051-4743-af26-0ff2766e110e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:08:59.272232 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-58125f35-b051-4743-af26-0ff2766e110e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:08:59.279357 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-58125f35-b051-4743-af26-0ff2766e110e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:59.279836 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-58125f35-b051-4743-af26-0ff2766e110e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:59.280641 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-58125f35-b051-4743-af26-0ff2766e110e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:08:59.281109 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-58125f35-b051-4743-af26-0ff2766e110e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:08:59.430537 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-58125f35-b051-4743-af26-0ff2766e110e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:59.444867 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-58125f35-b051-4743-af26-0ff2766e110e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:59.446432 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-58125f35-b051-4743-af26-0ff2766e110e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:08:59.447629 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-58125f35-b051-4743-af26-0ff2766e110e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1808 microversion: 2.20 time: 0.180020 May 31 21:08:59.448192 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 308/647] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:08:59 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1808 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:09:00.171387 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-a3d31198-f32b-4ef5-94b1-e09c6b84ed1a tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:09:00.172977 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-a3d31198-f32b-4ef5-94b1-e09c6b84ed1a tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:09:00.180266 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a3d31198-f32b-4ef5-94b1-e09c6b84ed1a tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:00.180766 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a3d31198-f32b-4ef5-94b1-e09c6b84ed1a tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:00.181637 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a3d31198-f32b-4ef5-94b1-e09c6b84ed1a tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:00.182292 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a3d31198-f32b-4ef5-94b1-e09c6b84ed1a tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:00.217930 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-ef9414e4-42ad-4198-a2d6-86726d16c97b tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:09:00.219313 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-ef9414e4-42ad-4198-a2d6-86726d16c97b tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 92254a91-6b12-4811-a58e-e6f4cac9d965] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:09:00.241328 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ef9414e4-42ad-4198-a2d6-86726d16c97b tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:00.243939 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ef9414e4-42ad-4198-a2d6-86726d16c97b tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:00.245342 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ef9414e4-42ad-4198-a2d6-86726d16c97b tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:00.246104 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ef9414e4-42ad-4198-a2d6-86726d16c97b tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:00.672519 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-a3d31198-f32b-4ef5-94b1-e09c6b84ed1a tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:09:00.681621 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-a3d31198-f32b-4ef5-94b1-e09c6b84ed1a tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1758 microversion: 2.1 time: 0.516472 May 31 21:09:00.682655 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 340/648] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:09:00 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1758 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:09:00.687782 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-67da16d6-7565-4c6c-b44a-d4fa0105778d tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:09:00.688509 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-67da16d6-7565-4c6c-b44a-d4fa0105778d tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:09:00.695196 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-67da16d6-7565-4c6c-b44a-d4fa0105778d tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:00.695945 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-67da16d6-7565-4c6c-b44a-d4fa0105778d tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:00.696907 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-67da16d6-7565-4c6c-b44a-d4fa0105778d tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:00.697349 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-67da16d6-7565-4c6c-b44a-d4fa0105778d tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:00.713247 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-ef9414e4-42ad-4198-a2d6-86726d16c97b tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:09:00.721165 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-ef9414e4-42ad-4198-a2d6-86726d16c97b tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965" status: 200 len: 1266 microversion: 2.1 time: 0.515911 May 31 21:09:00.721744 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 309/649] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:09:00 2022] GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965 => generated 1266 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:09:00.858167 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-67da16d6-7565-4c6c-b44a-d4fa0105778d tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:09:00.869534 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-67da16d6-7565-4c6c-b44a-d4fa0105778d tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:09:00.875167 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-67da16d6-7565-4c6c-b44a-d4fa0105778d tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:09:00.876376 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-67da16d6-7565-4c6c-b44a-d4fa0105778d tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1808 microversion: 2.20 time: 0.192902 May 31 21:09:00.877247 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 341/650] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:09:00 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1808 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:09:00.935098 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-81b8f407-610f-4c62-8227-fd1bd9055b8b tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d9275cb8-70e1-479f-ac4e-65d619bf907c"}} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:09:00.936521 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-81b8f407-610f-4c62-8227-fd1bd9055b8b tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:09:00.943685 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-81b8f407-610f-4c62-8227-fd1bd9055b8b tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:00.944153 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-81b8f407-610f-4c62-8227-fd1bd9055b8b tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:00.944959 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-81b8f407-610f-4c62-8227-fd1bd9055b8b tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:00.945393 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-81b8f407-610f-4c62-8227-fd1bd9055b8b tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:00.964791 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell1:SELECT=100 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:09:01.726621 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-81b8f407-610f-4c62-8227-fd1bd9055b8b tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "POST /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.003114 May 31 21:09:01.727302 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 310/651] 10.222.0.55 () {60 vars in 1322 bytes} [Tue May 31 21:09:00 2022] POST /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f/os-volume_attachments => generated 194 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:09:01.739138 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-eadb5db5-fe9f-46f0-8bdc-c0ee2bccf016 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:09:01.739749 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-eadb5db5-fe9f-46f0-8bdc-c0ee2bccf016 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 92254a91-6b12-4811-a58e-e6f4cac9d965] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:09:01.746667 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-eadb5db5-fe9f-46f0-8bdc-c0ee2bccf016 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:01.747119 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-eadb5db5-fe9f-46f0-8bdc-c0ee2bccf016 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:01.747921 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-eadb5db5-fe9f-46f0-8bdc-c0ee2bccf016 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:01.748353 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-eadb5db5-fe9f-46f0-8bdc-c0ee2bccf016 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:01.893137 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-eadb5db5-fe9f-46f0-8bdc-c0ee2bccf016 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:09:01.897307 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-e7f4eb5b-b018-4138-98fe-fc8bec46a6ef tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:09:01.898135 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-e7f4eb5b-b018-4138-98fe-fc8bec46a6ef tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:09:01.900734 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-eadb5db5-fe9f-46f0-8bdc-c0ee2bccf016 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965" status: 200 len: 1266 microversion: 2.1 time: 0.165728 May 31 21:09:01.901313 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 342/652] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:09:01 2022] GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:09:01.905043 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e7f4eb5b-b018-4138-98fe-fc8bec46a6ef tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:01.905564 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e7f4eb5b-b018-4138-98fe-fc8bec46a6ef tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:01.906546 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e7f4eb5b-b018-4138-98fe-fc8bec46a6ef tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:01.907192 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e7f4eb5b-b018-4138-98fe-fc8bec46a6ef tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:02.048637 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-e7f4eb5b-b018-4138-98fe-fc8bec46a6ef tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:09:02.057226 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-e7f4eb5b-b018-4138-98fe-fc8bec46a6ef tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:09:02.059013 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-e7f4eb5b-b018-4138-98fe-fc8bec46a6ef tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:09:02.060225 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-e7f4eb5b-b018-4138-98fe-fc8bec46a6ef tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1795 microversion: 2.20 time: 0.167223 May 31 21:09:02.060787 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 311/653] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:09:01 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1795 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:09:02.164968 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [req-2a0e0097-fa61-476e-a910-57ef00a5ba37 req-8713e159-2c67-43b0-bb67-9161398c2693 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92254a91-6b12-4811-a58e-e6f4cac9d965", "name": "network-vif-plugged", "status": "completed", "tag": "184f337b-0888-4e33-981f-ff3bb1208077"}]} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:09:02.173735 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-2a0e0097-fa61-476e-a910-57ef00a5ba37 req-8713e159-2c67-43b0-bb67-9161398c2693 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:02.174213 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-2a0e0097-fa61-476e-a910-57ef00a5ba37 req-8713e159-2c67-43b0-bb67-9161398c2693 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:02.184759 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.compute.server_external_events [req-2a0e0097-fa61-476e-a910-57ef00a5ba37 req-8713e159-2c67-43b0-bb67-9161398c2693 service nova] Creating event network-vif-plugged:184f337b-0888-4e33-981f-ff3bb1208077 for instance 92254a91-6b12-4811-a58e-e6f4cac9d965 on hv-cinder-83979 May 31 21:09:02.189626 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [req-2a0e0097-fa61-476e-a910-57ef00a5ba37 req-8713e159-2c67-43b0-bb67-9161398c2693 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086861 May 31 21:09:02.190242 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 343/654] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:09:02.918692 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-784e251b-cdcc-45b6-b710-b4eec4e1c5d6 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:09:02.919286 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-784e251b-cdcc-45b6-b710-b4eec4e1c5d6 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 92254a91-6b12-4811-a58e-e6f4cac9d965] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:09:02.926591 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-784e251b-cdcc-45b6-b710-b4eec4e1c5d6 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:02.927044 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-784e251b-cdcc-45b6-b710-b4eec4e1c5d6 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:02.927853 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-784e251b-cdcc-45b6-b710-b4eec4e1c5d6 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:02.928305 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-784e251b-cdcc-45b6-b710-b4eec4e1c5d6 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:03.062446 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-784e251b-cdcc-45b6-b710-b4eec4e1c5d6 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:09:03.069969 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-784e251b-cdcc-45b6-b710-b4eec4e1c5d6 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965" status: 200 len: 1266 microversion: 2.1 time: 0.155187 May 31 21:09:03.070528 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 312/655] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:09:02 2022] GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:09:04.088409 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-b8618a63-4e16-42e9-9d84-69ee928906e6 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:09:04.089137 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-b8618a63-4e16-42e9-9d84-69ee928906e6 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 92254a91-6b12-4811-a58e-e6f4cac9d965] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:09:04.095414 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b8618a63-4e16-42e9-9d84-69ee928906e6 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:04.095860 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b8618a63-4e16-42e9-9d84-69ee928906e6 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:04.096619 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b8618a63-4e16-42e9-9d84-69ee928906e6 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:04.097051 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b8618a63-4e16-42e9-9d84-69ee928906e6 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:04.226271 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-b8618a63-4e16-42e9-9d84-69ee928906e6 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:09:04.233824 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-b8618a63-4e16-42e9-9d84-69ee928906e6 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965" status: 200 len: 1266 microversion: 2.1 time: 0.150284 May 31 21:09:04.234426 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 344/656] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:09:04 2022] GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:09:05.251370 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-bef97143-c3c9-4f0a-8079-3605102643e4 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:09:05.251992 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-bef97143-c3c9-4f0a-8079-3605102643e4 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 92254a91-6b12-4811-a58e-e6f4cac9d965] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:09:05.258692 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-bef97143-c3c9-4f0a-8079-3605102643e4 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:05.259140 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-bef97143-c3c9-4f0a-8079-3605102643e4 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:05.259920 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-bef97143-c3c9-4f0a-8079-3605102643e4 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:05.260355 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-bef97143-c3c9-4f0a-8079-3605102643e4 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:05.394727 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-bef97143-c3c9-4f0a-8079-3605102643e4 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:09:05.402275 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-bef97143-c3c9-4f0a-8079-3605102643e4 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965" status: 200 len: 1453 microversion: 2.1 time: 0.154783 May 31 21:09:05.403409 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 313/657] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:09:05 2022] GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965 => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:09:05.419015 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-054e385b-7921-432e-9ec8-949e2ed7e339 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:09:05.420176 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-054e385b-7921-432e-9ec8-949e2ed7e339 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 92254a91-6b12-4811-a58e-e6f4cac9d965] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:09:05.426848 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-054e385b-7921-432e-9ec8-949e2ed7e339 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:05.427301 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-054e385b-7921-432e-9ec8-949e2ed7e339 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:05.428086 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-054e385b-7921-432e-9ec8-949e2ed7e339 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:05.428531 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-054e385b-7921-432e-9ec8-949e2ed7e339 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:05.564554 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-054e385b-7921-432e-9ec8-949e2ed7e339 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:09:05.571948 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-054e385b-7921-432e-9ec8-949e2ed7e339 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965" status: 200 len: 1453 microversion: 2.1 time: 0.156852 May 31 21:09:05.572620 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 345/658] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:09:05 2022] GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965 => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:09:07.780534 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [req-6fdfb2c2-f263-4121-a44a-3dcb58f0e48e req-691bfbe6-d714-4822-a62a-7e37e2c9a9ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92254a91-6b12-4811-a58e-e6f4cac9d965", "tag": "184f337b-0888-4e33-981f-ff3bb1208077"}]} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:09:07.784204 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_api:SELECT=72 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:09:07.789940 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-6fdfb2c2-f263-4121-a44a-3dcb58f0e48e req-691bfbe6-d714-4822-a62a-7e37e2c9a9ee service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:07.790411 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-6fdfb2c2-f263-4121-a44a-3dcb58f0e48e req-691bfbe6-d714-4822-a62a-7e37e2c9a9ee service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:07.803764 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.compute.server_external_events [req-6fdfb2c2-f263-4121-a44a-3dcb58f0e48e req-691bfbe6-d714-4822-a62a-7e37e2c9a9ee service nova] Creating event network-changed:184f337b-0888-4e33-981f-ff3bb1208077 for instance 92254a91-6b12-4811-a58e-e6f4cac9d965 on hv-cinder-83979 May 31 21:09:07.808699 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [req-6fdfb2c2-f263-4121-a44a-3dcb58f0e48e req-691bfbe6-d714-4822-a62a-7e37e2c9a9ee service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087379 May 31 21:09:07.809286 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 314/659] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:09:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:09:10.286374 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-4eb3e85b-4c63-4b90-a257-1fc6ee8db8a2 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:09:10.287317 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-4eb3e85b-4c63-4b90-a257-1fc6ee8db8a2 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:09:10.294260 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4eb3e85b-4c63-4b90-a257-1fc6ee8db8a2 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:10.295393 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4eb3e85b-4c63-4b90-a257-1fc6ee8db8a2 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:10.296174 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4eb3e85b-4c63-4b90-a257-1fc6ee8db8a2 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:10.296604 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4eb3e85b-4c63-4b90-a257-1fc6ee8db8a2 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:10.319423 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.objects.instance [None req-4eb3e85b-4c63-4b90-a257-1fc6ee8db8a2 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lazy-loading 'flavor' on Instance uuid ff87c7f6-31a7-4836-be01-c23f9c73629f {{(pid=118184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 21:09:10.684737 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-4eb3e85b-4c63-4b90-a257-1fc6ee8db8a2 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "POST /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f/action" status: 200 len: 32 microversion: 2.1 time: 0.402504 May 31 21:09:10.685976 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 346/660] 10.222.0.55 () {60 vars in 1277 bytes} [Tue May 31 21:09:10 2022] POST /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f/action => generated 32 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 31 21:09:10.696004 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-eb7d665b-054d-44e7-b0b5-ce6cf98307f6 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:09:10.696708 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-eb7d665b-054d-44e7-b0b5-ce6cf98307f6 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:09:10.703682 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-eb7d665b-054d-44e7-b0b5-ce6cf98307f6 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:10.704134 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-eb7d665b-054d-44e7-b0b5-ce6cf98307f6 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:10.704906 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-eb7d665b-054d-44e7-b0b5-ce6cf98307f6 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:10.705344 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-eb7d665b-054d-44e7-b0b5-ce6cf98307f6 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:10.845568 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-eb7d665b-054d-44e7-b0b5-ce6cf98307f6 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:09:10.853995 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-eb7d665b-054d-44e7-b0b5-ce6cf98307f6 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1736 microversion: 2.1 time: 0.162490 May 31 21:09:10.854565 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 315/661] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:09:10 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:09:11.873388 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-5e0e6253-c636-4fa2-976e-1e42d619cfe3 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:09:11.874122 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-5e0e6253-c636-4fa2-976e-1e42d619cfe3 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:09:11.880435 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5e0e6253-c636-4fa2-976e-1e42d619cfe3 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:11.880896 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5e0e6253-c636-4fa2-976e-1e42d619cfe3 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:11.881655 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5e0e6253-c636-4fa2-976e-1e42d619cfe3 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:11.882121 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5e0e6253-c636-4fa2-976e-1e42d619cfe3 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:12.017675 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-5e0e6253-c636-4fa2-976e-1e42d619cfe3 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:09:12.025774 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-5e0e6253-c636-4fa2-976e-1e42d619cfe3 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1736 microversion: 2.1 time: 0.157722 May 31 21:09:12.034008 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 347/662] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:09:11 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:09:13.047836 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-f6fc0ae1-0ce2-410f-a654-b8b7d4baaf7f tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:09:13.048383 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-f6fc0ae1-0ce2-410f-a654-b8b7d4baaf7f tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:09:13.055157 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f6fc0ae1-0ce2-410f-a654-b8b7d4baaf7f tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:13.055672 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f6fc0ae1-0ce2-410f-a654-b8b7d4baaf7f tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:13.056440 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f6fc0ae1-0ce2-410f-a654-b8b7d4baaf7f tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:13.056879 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f6fc0ae1-0ce2-410f-a654-b8b7d4baaf7f tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:13.183865 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-f6fc0ae1-0ce2-410f-a654-b8b7d4baaf7f tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:09:13.192273 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-f6fc0ae1-0ce2-410f-a654-b8b7d4baaf7f tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1736 microversion: 2.1 time: 0.149017 May 31 21:09:13.192846 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 316/663] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:09:13 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:09:14.210432 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-f21018e2-c6ce-46cf-a9d5-6db571bb792f tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:09:14.211036 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-f21018e2-c6ce-46cf-a9d5-6db571bb792f tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:09:14.217269 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f21018e2-c6ce-46cf-a9d5-6db571bb792f tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:14.217715 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f21018e2-c6ce-46cf-a9d5-6db571bb792f tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:14.218539 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f21018e2-c6ce-46cf-a9d5-6db571bb792f tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:14.218973 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f21018e2-c6ce-46cf-a9d5-6db571bb792f tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:14.349361 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-f21018e2-c6ce-46cf-a9d5-6db571bb792f tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:09:14.357778 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-f21018e2-c6ce-46cf-a9d5-6db571bb792f tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1736 microversion: 2.1 time: 0.151211 May 31 21:09:14.360961 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 348/664] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:09:14 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:09:15.375287 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-a4b2126a-7074-4e5f-b7d5-4aa11a660807 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:09:15.375846 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-a4b2126a-7074-4e5f-b7d5-4aa11a660807 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:09:15.382344 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a4b2126a-7074-4e5f-b7d5-4aa11a660807 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:15.382774 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a4b2126a-7074-4e5f-b7d5-4aa11a660807 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:15.383533 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a4b2126a-7074-4e5f-b7d5-4aa11a660807 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:15.383965 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a4b2126a-7074-4e5f-b7d5-4aa11a660807 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:15.512899 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-a4b2126a-7074-4e5f-b7d5-4aa11a660807 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:09:15.521496 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-a4b2126a-7074-4e5f-b7d5-4aa11a660807 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1736 microversion: 2.1 time: 0.150640 May 31 21:09:15.522089 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 317/665] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:09:15 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:09:16.538766 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-2508e1cb-04b3-40bf-bab5-8ade05e1b308 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:09:16.539392 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-2508e1cb-04b3-40bf-bab5-8ade05e1b308 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:09:16.546496 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2508e1cb-04b3-40bf-bab5-8ade05e1b308 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:16.549919 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2508e1cb-04b3-40bf-bab5-8ade05e1b308 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:16.549919 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2508e1cb-04b3-40bf-bab5-8ade05e1b308 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:16.549919 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2508e1cb-04b3-40bf-bab5-8ade05e1b308 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:16.680524 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-2508e1cb-04b3-40bf-bab5-8ade05e1b308 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:09:16.689080 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-2508e1cb-04b3-40bf-bab5-8ade05e1b308 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1736 microversion: 2.1 time: 0.154200 May 31 21:09:16.689657 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 349/666] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:09:16 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:09:17.707050 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-af45dea7-987f-4ac4-99a4-b430a49ac2ea tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:09:17.707663 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-af45dea7-987f-4ac4-99a4-b430a49ac2ea tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:09:17.714427 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-af45dea7-987f-4ac4-99a4-b430a49ac2ea tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:17.714883 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-af45dea7-987f-4ac4-99a4-b430a49ac2ea tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:17.715658 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-af45dea7-987f-4ac4-99a4-b430a49ac2ea tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:17.716103 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-af45dea7-987f-4ac4-99a4-b430a49ac2ea tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:17.847053 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-af45dea7-987f-4ac4-99a4-b430a49ac2ea tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:09:17.855091 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-af45dea7-987f-4ac4-99a4-b430a49ac2ea tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1736 microversion: 2.1 time: 0.151907 May 31 21:09:17.855660 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 318/667] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:09:17 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:09:18.873308 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-5ea32843-34a8-4532-8889-47fdc3f623b1 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:09:18.873975 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-5ea32843-34a8-4532-8889-47fdc3f623b1 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:09:18.880426 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5ea32843-34a8-4532-8889-47fdc3f623b1 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:18.880869 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5ea32843-34a8-4532-8889-47fdc3f623b1 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:18.881620 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5ea32843-34a8-4532-8889-47fdc3f623b1 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:18.882086 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5ea32843-34a8-4532-8889-47fdc3f623b1 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:19.013525 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-5ea32843-34a8-4532-8889-47fdc3f623b1 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:09:19.021509 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-5ea32843-34a8-4532-8889-47fdc3f623b1 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1736 microversion: 2.1 time: 0.152619 May 31 21:09:19.022072 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 350/668] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:09:18 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:09:20.038960 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-0bc8032c-d03b-4482-bbfe-b3be90049ee9 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:09:20.043697 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-0bc8032c-d03b-4482-bbfe-b3be90049ee9 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:09:20.051135 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-0bc8032c-d03b-4482-bbfe-b3be90049ee9 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:20.051694 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-0bc8032c-d03b-4482-bbfe-b3be90049ee9 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:20.052461 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-0bc8032c-d03b-4482-bbfe-b3be90049ee9 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:20.052895 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-0bc8032c-d03b-4482-bbfe-b3be90049ee9 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:20.179405 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-0bc8032c-d03b-4482-bbfe-b3be90049ee9 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:09:20.187549 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-0bc8032c-d03b-4482-bbfe-b3be90049ee9 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1736 microversion: 2.1 time: 0.152496 May 31 21:09:20.188106 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 319/669] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:09:20 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:09:21.205754 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-dbaee7e0-8dc9-4f91-99cf-73dc3131c06d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:09:21.206395 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-dbaee7e0-8dc9-4f91-99cf-73dc3131c06d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:09:21.213175 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-dbaee7e0-8dc9-4f91-99cf-73dc3131c06d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:21.213605 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-dbaee7e0-8dc9-4f91-99cf-73dc3131c06d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:21.214389 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-dbaee7e0-8dc9-4f91-99cf-73dc3131c06d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:21.214820 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-dbaee7e0-8dc9-4f91-99cf-73dc3131c06d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:21.343184 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-dbaee7e0-8dc9-4f91-99cf-73dc3131c06d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:09:21.352585 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-dbaee7e0-8dc9-4f91-99cf-73dc3131c06d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1736 microversion: 2.1 time: 0.149059 May 31 21:09:21.352585 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 351/670] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:09:21 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:09:22.368334 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-a770456b-a319-4751-9016-cd7bd4947878 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:09:22.368964 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-a770456b-a319-4751-9016-cd7bd4947878 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:09:22.376454 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a770456b-a319-4751-9016-cd7bd4947878 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:22.376896 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a770456b-a319-4751-9016-cd7bd4947878 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:22.377672 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a770456b-a319-4751-9016-cd7bd4947878 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:22.378130 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a770456b-a319-4751-9016-cd7bd4947878 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:22.516041 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-a770456b-a319-4751-9016-cd7bd4947878 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:09:22.524265 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-a770456b-a319-4751-9016-cd7bd4947878 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1736 microversion: 2.1 time: 0.159748 May 31 21:09:22.524852 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 320/671] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:09:22 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:09:23.541202 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-4b5222f7-6d97-44c4-90c1-5088017ae11e tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:09:23.541946 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-4b5222f7-6d97-44c4-90c1-5088017ae11e tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:09:23.549152 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4b5222f7-6d97-44c4-90c1-5088017ae11e tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:23.549692 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4b5222f7-6d97-44c4-90c1-5088017ae11e tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:23.550503 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4b5222f7-6d97-44c4-90c1-5088017ae11e tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:23.551115 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4b5222f7-6d97-44c4-90c1-5088017ae11e tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:23.695689 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-4b5222f7-6d97-44c4-90c1-5088017ae11e tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:09:23.699310 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:09:23.704875 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-4b5222f7-6d97-44c4-90c1-5088017ae11e tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1736 microversion: 2.1 time: 0.167540 May 31 21:09:23.705452 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 352/672] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:09:23 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:09:24.723365 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-a2c22706-ce48-4acc-9bf2-607982744ac5 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:09:24.723964 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-a2c22706-ce48-4acc-9bf2-607982744ac5 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:09:24.730747 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a2c22706-ce48-4acc-9bf2-607982744ac5 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:24.731193 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a2c22706-ce48-4acc-9bf2-607982744ac5 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:24.731961 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a2c22706-ce48-4acc-9bf2-607982744ac5 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:24.732397 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a2c22706-ce48-4acc-9bf2-607982744ac5 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:24.869206 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-a2c22706-ce48-4acc-9bf2-607982744ac5 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:09:24.878080 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-a2c22706-ce48-4acc-9bf2-607982744ac5 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1736 microversion: 2.1 time: 0.158484 May 31 21:09:24.878656 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 321/673] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:09:24 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:09:25.266596 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-f3b7e72d-9208-41cc-ab41-0f6e2609eabe tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:09:25.267094 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-f3b7e72d-9208-41cc-ab41-0f6e2609eabe tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:09:25.268960 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_api:SELECT=42 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:09:25.273634 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f3b7e72d-9208-41cc-ab41-0f6e2609eabe tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:25.274115 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f3b7e72d-9208-41cc-ab41-0f6e2609eabe tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:25.274965 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f3b7e72d-9208-41cc-ab41-0f6e2609eabe tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:25.275393 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f3b7e72d-9208-41cc-ab41-0f6e2609eabe tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:25.405061 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.objects.instance [None req-f3b7e72d-9208-41cc-ab41-0f6e2609eabe tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lazy-loading 'services' on Instance uuid faf12fce-2352-40df-a297-0d7b28379014 {{(pid=118184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 21:09:25.642480 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-f3b7e72d-9208-41cc-ab41-0f6e2609eabe tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "DELETE /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014/os-volume_attachments/60b581fc-08c4-44db-a8da-fde47f2b5b44" status: 202 len: 0 microversion: 2.1 time: 0.485305 May 31 21:09:25.643102 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 353/674] 10.222.0.55 () {58 vars in 1415 bytes} [Tue May 31 21:09:25 2022] DELETE /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014/os-volume_attachments/60b581fc-08c4-44db-a8da-fde47f2b5b44 => generated 0 bytes in 487 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 21:09:25.896854 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-e7720fa0-ce00-4655-9f60-d68677856dd0 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:09:25.897445 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-e7720fa0-ce00-4655-9f60-d68677856dd0 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:09:25.904154 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e7720fa0-ce00-4655-9f60-d68677856dd0 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:25.904597 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e7720fa0-ce00-4655-9f60-d68677856dd0 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:25.905369 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e7720fa0-ce00-4655-9f60-d68677856dd0 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:25.905800 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e7720fa0-ce00-4655-9f60-d68677856dd0 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:26.036188 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-e7720fa0-ce00-4655-9f60-d68677856dd0 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:09:26.044270 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-e7720fa0-ce00-4655-9f60-d68677856dd0 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1736 microversion: 2.1 time: 0.151697 May 31 21:09:26.044866 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 322/675] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:09:25 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:09:27.062742 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-9766b740-9ff6-4316-ba9b-f5efb11b7709 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:09:27.063373 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-9766b740-9ff6-4316-ba9b-f5efb11b7709 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:09:27.070245 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-9766b740-9ff6-4316-ba9b-f5efb11b7709 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:27.074692 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-9766b740-9ff6-4316-ba9b-f5efb11b7709 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:27.074692 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-9766b740-9ff6-4316-ba9b-f5efb11b7709 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:27.074692 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-9766b740-9ff6-4316-ba9b-f5efb11b7709 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:27.212018 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-9766b740-9ff6-4316-ba9b-f5efb11b7709 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:09:27.220895 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-9766b740-9ff6-4316-ba9b-f5efb11b7709 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1736 microversion: 2.1 time: 0.163755 May 31 21:09:27.221486 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 354/676] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:09:27 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:09:27.813500 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-be90f348-b07c-4a78-9f83-cb8843ff1c76 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:09:27.820425 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-be90f348-b07c-4a78-9f83-cb8843ff1c76 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:27.820870 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-be90f348-b07c-4a78-9f83-cb8843ff1c76 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:27.843726 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-be90f348-b07c-4a78-9f83-cb8843ff1c76 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Going to try to stop instance {{(pid=118185) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 31 21:09:28.045981 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-be90f348-b07c-4a78-9f83-cb8843ff1c76 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "POST /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014/action" status: 202 len: 0 microversion: 2.1 time: 0.236721 May 31 21:09:28.046594 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 323/677] 10.222.0.55 () {60 vars in 1277 bytes} [Tue May 31 21:09:27 2022] POST /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 21:09:28.056354 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-cfb495c0-9aec-459b-acff-74ae0a7b8208 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:09:28.057092 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-cfb495c0-9aec-459b-acff-74ae0a7b8208 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:09:28.064604 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-cfb495c0-9aec-459b-acff-74ae0a7b8208 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:28.069979 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-cfb495c0-9aec-459b-acff-74ae0a7b8208 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:28.069979 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-cfb495c0-9aec-459b-acff-74ae0a7b8208 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:28.069979 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-cfb495c0-9aec-459b-acff-74ae0a7b8208 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:28.203822 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-cfb495c0-9aec-459b-acff-74ae0a7b8208 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:09:28.211846 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-cfb495c0-9aec-459b-acff-74ae0a7b8208 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1677 microversion: 2.1 time: 0.159662 May 31 21:09:28.212424 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 355/678] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:09:28 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:09:28.238765 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-96179c1f-8086-43ab-928c-00071b0ddf89 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:09:28.239460 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-96179c1f-8086-43ab-928c-00071b0ddf89 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:09:28.245696 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-96179c1f-8086-43ab-928c-00071b0ddf89 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:28.246213 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-96179c1f-8086-43ab-928c-00071b0ddf89 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:28.246985 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-96179c1f-8086-43ab-928c-00071b0ddf89 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:28.248028 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-96179c1f-8086-43ab-928c-00071b0ddf89 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:28.379734 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-96179c1f-8086-43ab-928c-00071b0ddf89 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:09:28.387556 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-96179c1f-8086-43ab-928c-00071b0ddf89 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1736 microversion: 2.1 time: 0.153232 May 31 21:09:28.388170 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 324/679] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:09:28 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:09:29.228585 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-ef9b0039-b372-481b-a555-61f6259d9b74 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:09:29.229188 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-ef9b0039-b372-481b-a555-61f6259d9b74 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:09:29.236636 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ef9b0039-b372-481b-a555-61f6259d9b74 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:29.237076 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ef9b0039-b372-481b-a555-61f6259d9b74 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:29.237819 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ef9b0039-b372-481b-a555-61f6259d9b74 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:29.238277 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ef9b0039-b372-481b-a555-61f6259d9b74 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:29.373526 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-ef9b0039-b372-481b-a555-61f6259d9b74 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:09:29.380892 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-ef9b0039-b372-481b-a555-61f6259d9b74 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1677 microversion: 2.1 time: 0.156208 May 31 21:09:29.381454 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 356/680] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:09:29 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:09:29.404296 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-dc4af04e-1172-4905-a0ea-aa28286d12c8 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:09:29.404897 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-dc4af04e-1172-4905-a0ea-aa28286d12c8 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:09:29.411235 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-dc4af04e-1172-4905-a0ea-aa28286d12c8 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:29.411680 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-dc4af04e-1172-4905-a0ea-aa28286d12c8 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:29.412435 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-dc4af04e-1172-4905-a0ea-aa28286d12c8 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:29.412865 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-dc4af04e-1172-4905-a0ea-aa28286d12c8 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:29.431197 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:09:29.541705 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-dc4af04e-1172-4905-a0ea-aa28286d12c8 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:09:29.550160 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-dc4af04e-1172-4905-a0ea-aa28286d12c8 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1736 microversion: 2.1 time: 0.149620 May 31 21:09:29.550730 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 325/681] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:09:29 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:09:30.397991 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-094624f3-3096-4f9d-ab71-a0582cae36df tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:09:30.398593 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-094624f3-3096-4f9d-ab71-a0582cae36df tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:09:30.404930 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-094624f3-3096-4f9d-ab71-a0582cae36df tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:30.405376 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-094624f3-3096-4f9d-ab71-a0582cae36df tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:30.406166 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-094624f3-3096-4f9d-ab71-a0582cae36df tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:30.406596 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-094624f3-3096-4f9d-ab71-a0582cae36df tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:30.567833 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-edfa9811-08ce-4fa5-bc83-9b61064f557f tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:09:30.568414 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-edfa9811-08ce-4fa5-bc83-9b61064f557f tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:09:30.575189 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-edfa9811-08ce-4fa5-bc83-9b61064f557f tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:30.575785 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-edfa9811-08ce-4fa5-bc83-9b61064f557f tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:30.576565 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-edfa9811-08ce-4fa5-bc83-9b61064f557f tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:30.576998 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-edfa9811-08ce-4fa5-bc83-9b61064f557f tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:30.761425 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-094624f3-3096-4f9d-ab71-a0582cae36df tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:09:30.765391 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-edfa9811-08ce-4fa5-bc83-9b61064f557f tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:09:30.769827 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-094624f3-3096-4f9d-ab71-a0582cae36df tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1677 microversion: 2.1 time: 0.375668 May 31 21:09:30.770498 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 357/682] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:09:30 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1677 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:09:30.773769 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-edfa9811-08ce-4fa5-bc83-9b61064f557f tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1736 microversion: 2.1 time: 0.210124 May 31 21:09:30.774462 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 326/683] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:09:30 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1736 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:09:31.788263 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-b4af9707-77fd-4a11-9269-5054851b13a4 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:09:31.788849 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-b4af9707-77fd-4a11-9269-5054851b13a4 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:09:31.793311 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-33516a17-a68f-407f-97b9-c905baa53e25 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:09:31.794334 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-33516a17-a68f-407f-97b9-c905baa53e25 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:09:31.795916 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b4af9707-77fd-4a11-9269-5054851b13a4 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:31.797014 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b4af9707-77fd-4a11-9269-5054851b13a4 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:31.798041 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b4af9707-77fd-4a11-9269-5054851b13a4 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:31.798277 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b4af9707-77fd-4a11-9269-5054851b13a4 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:31.801076 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-33516a17-a68f-407f-97b9-c905baa53e25 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:31.801550 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-33516a17-a68f-407f-97b9-c905baa53e25 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:31.803773 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-33516a17-a68f-407f-97b9-c905baa53e25 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:31.803773 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-33516a17-a68f-407f-97b9-c905baa53e25 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:31.998057 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-b4af9707-77fd-4a11-9269-5054851b13a4 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:09:32.001840 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-33516a17-a68f-407f-97b9-c905baa53e25 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:09:32.005536 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-b4af9707-77fd-4a11-9269-5054851b13a4 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1677 microversion: 2.1 time: 0.221595 May 31 21:09:32.006134 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 358/684] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:09:31 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1677 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:09:32.010115 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-33516a17-a68f-407f-97b9-c905baa53e25 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1736 microversion: 2.1 time: 0.221603 May 31 21:09:32.010852 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 327/685] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:09:31 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1736 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:09:33.024327 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-f5bf4b30-db9b-4f6d-981b-5902c6f68ec2 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:09:33.024931 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-f5bf4b30-db9b-4f6d-981b-5902c6f68ec2 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:09:33.027336 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-8de6f34f-6bde-4957-933b-6654c578fd31 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:09:33.027956 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-8de6f34f-6bde-4957-933b-6654c578fd31 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:09:33.035035 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f5bf4b30-db9b-4f6d-981b-5902c6f68ec2 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:33.035035 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f5bf4b30-db9b-4f6d-981b-5902c6f68ec2 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:33.035035 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f5bf4b30-db9b-4f6d-981b-5902c6f68ec2 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:33.035035 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f5bf4b30-db9b-4f6d-981b-5902c6f68ec2 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:33.035432 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-8de6f34f-6bde-4957-933b-6654c578fd31 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:33.035432 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-8de6f34f-6bde-4957-933b-6654c578fd31 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:33.035785 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-8de6f34f-6bde-4957-933b-6654c578fd31 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:33.036224 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-8de6f34f-6bde-4957-933b-6654c578fd31 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:33.223560 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-f5bf4b30-db9b-4f6d-981b-5902c6f68ec2 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:09:33.231315 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-f5bf4b30-db9b-4f6d-981b-5902c6f68ec2 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1677 microversion: 2.1 time: 0.210822 May 31 21:09:33.232710 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 359/686] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:09:33 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1677 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:09:33.236500 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-8de6f34f-6bde-4957-933b-6654c578fd31 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:09:33.244695 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-8de6f34f-6bde-4957-933b-6654c578fd31 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1736 microversion: 2.1 time: 0.221302 May 31 21:09:33.245269 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 328/687] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:09:33 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1736 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:09:34.249050 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-82c3f697-c21e-4184-9d07-c43c6815bb66 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:09:34.249647 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-82c3f697-c21e-4184-9d07-c43c6815bb66 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:09:34.256166 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-82c3f697-c21e-4184-9d07-c43c6815bb66 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:34.256694 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-82c3f697-c21e-4184-9d07-c43c6815bb66 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:34.257465 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-82c3f697-c21e-4184-9d07-c43c6815bb66 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:34.257922 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-82c3f697-c21e-4184-9d07-c43c6815bb66 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:34.261657 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-1ee38eec-7daa-4ac3-9987-65be17cb92ff tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:09:34.262285 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-1ee38eec-7daa-4ac3-9987-65be17cb92ff tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:09:34.269299 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-1ee38eec-7daa-4ac3-9987-65be17cb92ff tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:34.269745 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-1ee38eec-7daa-4ac3-9987-65be17cb92ff tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:34.270549 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-1ee38eec-7daa-4ac3-9987-65be17cb92ff tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:34.270983 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-1ee38eec-7daa-4ac3-9987-65be17cb92ff tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:34.459360 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-82c3f697-c21e-4184-9d07-c43c6815bb66 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:09:34.462538 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-1ee38eec-7daa-4ac3-9987-65be17cb92ff tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:09:34.467164 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-82c3f697-c21e-4184-9d07-c43c6815bb66 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1677 microversion: 2.1 time: 0.222455 May 31 21:09:34.467736 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 360/688] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:09:34 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1677 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:09:34.470539 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-1ee38eec-7daa-4ac3-9987-65be17cb92ff tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1736 microversion: 2.1 time: 0.212625 May 31 21:09:34.471103 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 329/689] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:09:34 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1736 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:09:35.484832 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-aa79b3f6-e709-4d18-8ade-a9a42bbfd9bf tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:09:35.485441 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-aa79b3f6-e709-4d18-8ade-a9a42bbfd9bf tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:09:35.487454 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-4ffebb68-c49e-4c15-96a2-ed974fd9969e tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:09:35.488066 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-4ffebb68-c49e-4c15-96a2-ed974fd9969e tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:09:35.492548 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-aa79b3f6-e709-4d18-8ade-a9a42bbfd9bf tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:35.493001 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-aa79b3f6-e709-4d18-8ade-a9a42bbfd9bf tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:35.493780 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-aa79b3f6-e709-4d18-8ade-a9a42bbfd9bf tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:35.494244 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-aa79b3f6-e709-4d18-8ade-a9a42bbfd9bf tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:35.494774 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4ffebb68-c49e-4c15-96a2-ed974fd9969e tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:35.495234 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4ffebb68-c49e-4c15-96a2-ed974fd9969e tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:35.496010 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4ffebb68-c49e-4c15-96a2-ed974fd9969e tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:35.496455 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4ffebb68-c49e-4c15-96a2-ed974fd9969e tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:35.691537 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-aa79b3f6-e709-4d18-8ade-a9a42bbfd9bf tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:09:35.695525 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-4ffebb68-c49e-4c15-96a2-ed974fd9969e tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:09:35.704648 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-4ffebb68-c49e-4c15-96a2-ed974fd9969e tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1736 microversion: 2.1 time: 0.220923 May 31 21:09:35.705224 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 330/690] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:09:35 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1736 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:09:35.708112 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-aa79b3f6-e709-4d18-8ade-a9a42bbfd9bf tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1677 microversion: 2.1 time: 0.227419 May 31 21:09:35.709300 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 361/691] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:09:35 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1677 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:09:36.723248 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-56581a73-2751-4706-852a-3ecd97e011fc tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:09:36.723999 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-56581a73-2751-4706-852a-3ecd97e011fc tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:09:36.726216 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-22d0dc81-9ea6-42ba-a62e-8fc2ffeab90d tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:09:36.726857 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-22d0dc81-9ea6-42ba-a62e-8fc2ffeab90d tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:09:36.730740 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-56581a73-2751-4706-852a-3ecd97e011fc tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:36.731194 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-56581a73-2751-4706-852a-3ecd97e011fc tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:36.732000 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-56581a73-2751-4706-852a-3ecd97e011fc tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:36.732438 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-56581a73-2751-4706-852a-3ecd97e011fc tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:36.733404 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-22d0dc81-9ea6-42ba-a62e-8fc2ffeab90d tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:36.733850 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-22d0dc81-9ea6-42ba-a62e-8fc2ffeab90d tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:36.734647 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-22d0dc81-9ea6-42ba-a62e-8fc2ffeab90d tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:36.735077 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-22d0dc81-9ea6-42ba-a62e-8fc2ffeab90d tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:37.150401 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-56581a73-2751-4706-852a-3ecd97e011fc tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:09:37.153131 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-22d0dc81-9ea6-42ba-a62e-8fc2ffeab90d tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:09:37.158651 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-56581a73-2751-4706-852a-3ecd97e011fc tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1716 microversion: 2.1 time: 0.439559 May 31 21:09:37.159255 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 331/692] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:09:36 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1716 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:09:37.160609 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-22d0dc81-9ea6-42ba-a62e-8fc2ffeab90d tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1677 microversion: 2.1 time: 0.438480 May 31 21:09:37.161163 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 362/693] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:09:36 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1677 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:09:37.214542 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-6d948d9b-6da4-4c75-ae71-0ac0a033e081 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:09:37.215040 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-6d948d9b-6da4-4c75-ae71-0ac0a033e081 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:09:37.220996 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-6d948d9b-6da4-4c75-ae71-0ac0a033e081 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:37.221455 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-6d948d9b-6da4-4c75-ae71-0ac0a033e081 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:37.222272 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-6d948d9b-6da4-4c75-ae71-0ac0a033e081 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:37.222716 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-6d948d9b-6da4-4c75-ae71-0ac0a033e081 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:37.346255 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.wsgi [None req-6d948d9b-6da4-4c75-ae71-0ac0a033e081 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] HTTP exception thrown: Cannot 'detach_volume' instance ff87c7f6-31a7-4836-be01-c23f9c73629f while it is in vm_state rescued May 31 21:09:37.347983 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-6d948d9b-6da4-4c75-ae71-0ac0a033e081 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Request method failure captured: May 31 21:09:37.347983 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: request: DELETE /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f/os-volume_attachments/d9275cb8-70e1-479f-ac4e-65d619bf907c HTTP/1.1 May 31 21:09:37.347983 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Accept: application/json May 31 21:09:37.347983 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Accept-Encoding: identity May 31 21:09:37.347983 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Connection: close May 31 21:09:37.347983 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Content-Length: 0 May 31 21:09:37.347983 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Content-Type: application/json May 31 21:09:37.347983 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Host: 10.222.0.55 May 31 21:09:37.347983 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Openstack-System-Scope: None May 31 21:09:37.347983 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: User-Agent: python-urllib3/1.26.9 May 31 21:09:37.347983 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Auth-Token: gAAAAABiloKngpou4fcrhJSECdfOHFsnMzu14lCOGutNAWHrekz0pgYMq4g1wmFaJxYB11cNdAFG04NttpTVQ0IQX971BK1KwyKsW5u5cbGZqnRRimaXJ-Df08ghf2T6DQWELhQSwIrMDVTC_eNXuZkmjTncSbGwdASXfJc-kC3SbyJrBM1jos4 May 31 21:09:37.347983 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Domain-Id: None May 31 21:09:37.347983 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Domain-Name: None May 31 21:09:37.347983 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Identity-Status: Confirmed May 31 21:09:37.347983 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Is-Admin-Project: True May 31 21:09:37.347983 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Domain-Id: default May 31 21:09:37.347983 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Domain-Name: Default May 31 21:09:37.347983 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Id: f1b54ceb69fc4041b743a11eda4144a8 May 31 21:09:37.347983 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1103944919 May 31 21:09:37.347983 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Role: member,reader May 31 21:09:37.347983 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Roles: member,reader May 31 21:09:37.349424 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/f1b54ceb69fc4041b743a11eda4144a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f1b54ceb69fc4041b743a11eda4144a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_f1b54ceb69fc4041b743a11eda4144a8", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f1b54ceb69fc4041b743a11eda4144a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] May 31 21:09:37.349424 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1103944919 May 31 21:09:37.349424 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant-Id: f1b54ceb69fc4041b743a11eda4144a8 May 31 21:09:37.349424 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1103944919 May 31 21:09:37.349424 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User: tempest-ServerRescueNegativeTestJSON-1103944919-project May 31 21:09:37.349424 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Domain-Id: default May 31 21:09:37.349424 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Domain-Name: Default May 31 21:09:37.349424 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Id: bbf377756836405d804d2aaba6e44c1f May 31 21:09:37.349424 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1103944919-project May 31 21:09:37.349424 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: method: > May 31 21:09:37.349424 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: exception: Cannot 'detach_volume' instance ff87c7f6-31a7-4836-be01-c23f9c73629f while it is in vm_state rescued May 31 21:09:37.350331 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: action_args: {'server_id': 'ff87c7f6-31a7-4836-be01-c23f9c73629f', 'id': 'd9275cb8-70e1-479f-ac4e-65d619bf907c'} May 31 21:09:37.350331 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 21:09:37.350331 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:09:37.350331 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 31 21:09:37.350331 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 31 21:09:37.350331 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 31 21:09:37.350331 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 31 21:09:37.350331 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 31 21:09:37.350331 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 31 21:09:37.350331 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ff87c7f6-31a7-4836-be01-c23f9c73629f in vm_state rescued. Cannot detach_volume while the instance is in this state. May 31 21:09:37.350331 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:09:37.350331 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:09:37.350331 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:09:37.350331 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:09:37.350331 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:09:37.350331 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:09:37.350331 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 21:09:37.350331 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 21:09:37.350331 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 21:09:37.350331 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 21:09:37.351974 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 31 21:09:37.351974 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 31 21:09:37.351974 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 31 21:09:37.351974 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 31 21:09:37.351974 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance ff87c7f6-31a7-4836-be01-c23f9c73629f while it is in vm_state rescued May 31 21:09:37.351974 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:09:37.351974 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:09:37.351974 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:09:37.351974 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:09:37.351974 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:09:37.351974 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:09:37.351974 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 21:09:37.351974 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 21:09:37.351974 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance ff87c7f6-31a7-4836-be01-c23f9c73629f while it is in vm_state rescued May 31 21:09:37.351974 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:09:37.351974 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-6d948d9b-6da4-4c75-ae71-0ac0a033e081 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Returning 409 to user: Cannot 'detach_volume' instance ff87c7f6-31a7-4836-be01-c23f9c73629f while it is in vm_state rescued {{(pid=118185) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 21:09:37.353306 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-6d948d9b-6da4-4c75-ae71-0ac0a033e081 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "DELETE /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f/os-volume_attachments/d9275cb8-70e1-479f-ac4e-65d619bf907c" status: 409 len: 152 microversion: 2.1 time: 0.138903 May 31 21:09:37.353306 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 332/694] 10.222.0.55 () {58 vars in 1415 bytes} [Tue May 31 21:09:37 2022] DELETE /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f/os-volume_attachments/d9275cb8-70e1-479f-ac4e-65d619bf907c => generated 152 bytes in 140 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 31 21:09:37.358628 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-acb014ad-a379-413c-819a-33c74352dccc tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:09:37.359162 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-acb014ad-a379-413c-819a-33c74352dccc tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:09:37.365081 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-acb014ad-a379-413c-819a-33c74352dccc tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:37.365557 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-acb014ad-a379-413c-819a-33c74352dccc tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:37.366319 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-acb014ad-a379-413c-819a-33c74352dccc tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:37.366759 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-acb014ad-a379-413c-819a-33c74352dccc tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:37.526456 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-acb014ad-a379-413c-819a-33c74352dccc tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "POST /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f/action" status: 202 len: 0 microversion: 2.1 time: 0.171248 May 31 21:09:37.527371 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 363/695] 10.222.0.55 () {60 vars in 1277 bytes} [Tue May 31 21:09:37 2022] POST /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 21:09:37.539399 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-1172742b-36eb-4835-86f9-14a5d35a7bec tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:09:37.541029 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-1172742b-36eb-4835-86f9-14a5d35a7bec tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:09:37.550903 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-1172742b-36eb-4835-86f9-14a5d35a7bec tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:37.551447 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-1172742b-36eb-4835-86f9-14a5d35a7bec tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:37.552337 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-1172742b-36eb-4835-86f9-14a5d35a7bec tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:37.552826 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-1172742b-36eb-4835-86f9-14a5d35a7bec tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:37.686203 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-1172742b-36eb-4835-86f9-14a5d35a7bec tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:09:37.694143 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-1172742b-36eb-4835-86f9-14a5d35a7bec tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1724 microversion: 2.1 time: 0.161829 May 31 21:09:37.694988 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 333/696] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:09:37 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:09:38.177531 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-705ae362-d66e-419f-84b4-a9c76c4804bc tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:09:38.178379 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-705ae362-d66e-419f-84b4-a9c76c4804bc tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:09:38.185636 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-705ae362-d66e-419f-84b4-a9c76c4804bc tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:38.186116 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-705ae362-d66e-419f-84b4-a9c76c4804bc tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:38.186894 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-705ae362-d66e-419f-84b4-a9c76c4804bc tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:38.187329 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-705ae362-d66e-419f-84b4-a9c76c4804bc tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:38.319140 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-705ae362-d66e-419f-84b4-a9c76c4804bc tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:09:38.326633 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-705ae362-d66e-419f-84b4-a9c76c4804bc tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1677 microversion: 2.1 time: 0.153325 May 31 21:09:38.327197 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 364/697] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:09:38 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:09:38.712526 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-acd8fcd1-e23b-456d-b47f-899b4981a58c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:09:38.713134 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-acd8fcd1-e23b-456d-b47f-899b4981a58c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:09:38.719767 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-acd8fcd1-e23b-456d-b47f-899b4981a58c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:38.720354 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-acd8fcd1-e23b-456d-b47f-899b4981a58c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:38.721131 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-acd8fcd1-e23b-456d-b47f-899b4981a58c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:38.721574 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-acd8fcd1-e23b-456d-b47f-899b4981a58c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:38.852678 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-acd8fcd1-e23b-456d-b47f-899b4981a58c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:09:38.861379 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-acd8fcd1-e23b-456d-b47f-899b4981a58c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1724 microversion: 2.1 time: 0.152955 May 31 21:09:38.861963 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 334/698] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:09:38 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:09:39.344487 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-6d75ca59-c24e-46e0-a944-fa184f0488e6 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:09:39.345149 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-6d75ca59-c24e-46e0-a944-fa184f0488e6 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:09:39.351679 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6d75ca59-c24e-46e0-a944-fa184f0488e6 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:39.352132 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6d75ca59-c24e-46e0-a944-fa184f0488e6 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:39.352904 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6d75ca59-c24e-46e0-a944-fa184f0488e6 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:39.353345 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6d75ca59-c24e-46e0-a944-fa184f0488e6 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:39.482625 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-6d75ca59-c24e-46e0-a944-fa184f0488e6 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:09:39.489994 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-6d75ca59-c24e-46e0-a944-fa184f0488e6 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1654 microversion: 2.1 time: 0.149865 May 31 21:09:39.490554 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 365/699] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:09:39 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1654 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:09:39.506754 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-da7faa29-13a9-404e-b035-3b7382498d86 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:09:39.512798 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-da7faa29-13a9-404e-b035-3b7382498d86 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:39.513861 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-da7faa29-13a9-404e-b035-3b7382498d86 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:39.537545 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-da7faa29-13a9-404e-b035-3b7382498d86 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Going to try to start instance {{(pid=118185) start /opt/stack/nova/nova/compute/api.py:2730}} May 31 21:09:39.723447 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-da7faa29-13a9-404e-b035-3b7382498d86 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "POST /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014/action" status: 202 len: 0 microversion: 2.1 time: 0.220355 May 31 21:09:39.724122 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 335/700] 10.222.0.55 () {60 vars in 1277 bytes} [Tue May 31 21:09:39 2022] POST /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 21:09:39.732457 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-80ba56e7-638a-45e7-b301-fdbef0a2b94b tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:09:39.733060 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-80ba56e7-638a-45e7-b301-fdbef0a2b94b tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:09:39.739202 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-80ba56e7-638a-45e7-b301-fdbef0a2b94b tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:39.739645 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-80ba56e7-638a-45e7-b301-fdbef0a2b94b tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:39.740395 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-80ba56e7-638a-45e7-b301-fdbef0a2b94b tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:39.740824 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-80ba56e7-638a-45e7-b301-fdbef0a2b94b tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:39.868783 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-80ba56e7-638a-45e7-b301-fdbef0a2b94b tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:09:39.876495 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-80ba56e7-638a-45e7-b301-fdbef0a2b94b tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1663 microversion: 2.1 time: 0.148059 May 31 21:09:39.877074 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 366/701] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:09:39 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1663 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:09:39.879292 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-b881e53c-ab38-4a4a-91e8-3fb4ffce4986 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:09:39.879986 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-b881e53c-ab38-4a4a-91e8-3fb4ffce4986 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:09:39.886251 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b881e53c-ab38-4a4a-91e8-3fb4ffce4986 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:39.886702 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b881e53c-ab38-4a4a-91e8-3fb4ffce4986 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:39.887472 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b881e53c-ab38-4a4a-91e8-3fb4ffce4986 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:39.887909 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b881e53c-ab38-4a4a-91e8-3fb4ffce4986 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:40.016235 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-b881e53c-ab38-4a4a-91e8-3fb4ffce4986 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:09:40.024159 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-b881e53c-ab38-4a4a-91e8-3fb4ffce4986 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1724 microversion: 2.1 time: 0.149217 May 31 21:09:40.030748 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 336/702] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:09:39 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:09:40.894633 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-7d81390f-8559-4593-b414-78d476158830 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:09:40.895169 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-7d81390f-8559-4593-b414-78d476158830 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:09:40.901590 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7d81390f-8559-4593-b414-78d476158830 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:40.902123 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7d81390f-8559-4593-b414-78d476158830 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:40.902945 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7d81390f-8559-4593-b414-78d476158830 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:40.903390 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7d81390f-8559-4593-b414-78d476158830 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:41.033978 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-7d81390f-8559-4593-b414-78d476158830 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:09:41.037749 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:09:41.042369 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-7d81390f-8559-4593-b414-78d476158830 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1663 microversion: 2.1 time: 0.151715 May 31 21:09:41.042928 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 367/703] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:09:40 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1663 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:09:41.049481 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-b6e2ff66-54af-4137-8671-8316216240af tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:09:41.051260 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-b6e2ff66-54af-4137-8671-8316216240af tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:09:41.057168 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_api:SELECT=46 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:09:41.063349 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b6e2ff66-54af-4137-8671-8316216240af tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:41.064431 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b6e2ff66-54af-4137-8671-8316216240af tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:41.066207 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b6e2ff66-54af-4137-8671-8316216240af tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:41.067082 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b6e2ff66-54af-4137-8671-8316216240af tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:41.203288 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-b6e2ff66-54af-4137-8671-8316216240af tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:09:41.211782 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-b6e2ff66-54af-4137-8671-8316216240af tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1730 microversion: 2.1 time: 0.169405 May 31 21:09:41.212348 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 337/704] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:09:41 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:09:41.229382 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-06a7cc25-be2f-4bc2-8ab3-6ceb937d7830 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:09:41.230075 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-06a7cc25-be2f-4bc2-8ab3-6ceb937d7830 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:09:41.236634 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-06a7cc25-be2f-4bc2-8ab3-6ceb937d7830 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:41.237087 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-06a7cc25-be2f-4bc2-8ab3-6ceb937d7830 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:41.237918 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-06a7cc25-be2f-4bc2-8ab3-6ceb937d7830 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:41.238366 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-06a7cc25-be2f-4bc2-8ab3-6ceb937d7830 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:41.318127 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-06a7cc25-be2f-4bc2-8ab3-6ceb937d7830 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092973 May 31 21:09:41.318780 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 368/705] 10.222.0.55 () {58 vars in 1274 bytes} [Tue May 31 21:09:41 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:09:42.069775 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-4ea5b679-72b5-404b-a7b8-c65fdf4eeaad tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:09:42.070540 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-4ea5b679-72b5-404b-a7b8-c65fdf4eeaad tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:09:42.078127 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4ea5b679-72b5-404b-a7b8-c65fdf4eeaad tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:42.078605 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4ea5b679-72b5-404b-a7b8-c65fdf4eeaad tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:42.079388 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4ea5b679-72b5-404b-a7b8-c65fdf4eeaad tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:42.079838 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4ea5b679-72b5-404b-a7b8-c65fdf4eeaad tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:42.300342 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-4ea5b679-72b5-404b-a7b8-c65fdf4eeaad tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:09:42.308970 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-4ea5b679-72b5-404b-a7b8-c65fdf4eeaad tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1663 microversion: 2.1 time: 0.243401 May 31 21:09:42.309544 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 338/706] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:09:42 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1663 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:09:42.327120 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [req-a6f61c7e-ee34-4d04-bb7e-9dc70f64bef3 req-05e6bb8c-522a-4922-aa5c-632458faccf5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff87c7f6-31a7-4836-be01-c23f9c73629f", "tag": "f7d9ea30-c776-41ba-8cc7-b1d9dce9aa77"}]} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:09:42.337155 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-a6f61c7e-ee34-4d04-bb7e-9dc70f64bef3 req-05e6bb8c-522a-4922-aa5c-632458faccf5 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:42.337834 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-a6f61c7e-ee34-4d04-bb7e-9dc70f64bef3 req-05e6bb8c-522a-4922-aa5c-632458faccf5 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:42.350265 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.compute.server_external_events [req-a6f61c7e-ee34-4d04-bb7e-9dc70f64bef3 req-05e6bb8c-522a-4922-aa5c-632458faccf5 service nova] Creating event network-changed:f7d9ea30-c776-41ba-8cc7-b1d9dce9aa77 for instance ff87c7f6-31a7-4836-be01-c23f9c73629f on hv-cinder-83979 May 31 21:09:42.355001 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [req-a6f61c7e-ee34-4d04-bb7e-9dc70f64bef3 req-05e6bb8c-522a-4922-aa5c-632458faccf5 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033069 May 31 21:09:42.355605 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 369/707] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:09:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:09:43.327099 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-741ef031-d407-481a-b3c1-fef4320e70d7 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:09:43.327693 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-741ef031-d407-481a-b3c1-fef4320e70d7 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:09:43.334607 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-741ef031-d407-481a-b3c1-fef4320e70d7 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:43.335053 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-741ef031-d407-481a-b3c1-fef4320e70d7 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:43.335822 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-741ef031-d407-481a-b3c1-fef4320e70d7 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:43.336258 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-741ef031-d407-481a-b3c1-fef4320e70d7 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:43.469544 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-741ef031-d407-481a-b3c1-fef4320e70d7 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:09:43.476983 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-741ef031-d407-481a-b3c1-fef4320e70d7 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1667 microversion: 2.1 time: 0.153768 May 31 21:09:43.477582 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 339/708] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:09:43 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1667 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:09:44.370532 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [req-422bc37c-8695-41d5-a6cd-8b66786a50af req-6d85a4c4-f968-46a3-8d04-fc3e176d2abd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff87c7f6-31a7-4836-be01-c23f9c73629f", "tag": "f7d9ea30-c776-41ba-8cc7-b1d9dce9aa77"}]} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:09:44.379590 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-422bc37c-8695-41d5-a6cd-8b66786a50af req-6d85a4c4-f968-46a3-8d04-fc3e176d2abd service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:09:44.379960 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-422bc37c-8695-41d5-a6cd-8b66786a50af req-6d85a4c4-f968-46a3-8d04-fc3e176d2abd service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:09:44.392269 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.compute.server_external_events [req-422bc37c-8695-41d5-a6cd-8b66786a50af req-6d85a4c4-f968-46a3-8d04-fc3e176d2abd service nova] Creating event network-changed:f7d9ea30-c776-41ba-8cc7-b1d9dce9aa77 for instance ff87c7f6-31a7-4836-be01-c23f9c73629f on hv-cinder-83979 May 31 21:09:44.397161 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [req-422bc37c-8695-41d5-a6cd-8b66786a50af req-6d85a4c4-f968-46a3-8d04-fc3e176d2abd service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031193 May 31 21:09:44.397783 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 370/709] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:10:08.440334 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-1d3086fa-fb1c-4040-bc14-7b38e6124560 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1064894292"}} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:10:08.440935 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-1d3086fa-fb1c-4040-bc14-7b38e6124560 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:10:08.443034 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_api:SELECT=5 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:10:08.443713 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:10:08.448445 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-1d3086fa-fb1c-4040-bc14-7b38e6124560 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:08.448887 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-1d3086fa-fb1c-4040-bc14-7b38e6124560 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:08.449654 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-1d3086fa-fb1c-4040-bc14-7b38e6124560 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:08.450120 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-1d3086fa-fb1c-4040-bc14-7b38e6124560 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:08.576443 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.network.security_group_api [None req-1d3086fa-fb1c-4040-bc14-7b38e6124560 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Removing security group 4ed228bd-5021-4a8b-93b3-efccb0105eda from port 6ba426b9-2ac4-463e-bc64-9ae379649087 May 31 21:10:09.047378 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-1d3086fa-fb1c-4040-bc14-7b38e6124560 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "POST /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c/action" status: 202 len: 0 microversion: 2.1 time: 0.611425 May 31 21:10:09.051016 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 340/710] 10.222.0.55 () {60 vars in 1277 bytes} [Tue May 31 21:10:08 2022] POST /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c/action => generated 0 bytes in 613 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 21:10:09.061030 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [req-9a20755c-6ccc-405f-9e29-ee0083ecbad2 req-f45808e0-5b3c-465f-93bc-ec2766a3003f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "979133c4-01ae-4510-8d70-018170135a6c", "tag": "6ba426b9-2ac4-463e-bc64-9ae379649087"}]} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:10:09.067412 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_api:SELECT=35 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:10:09.068533 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell1:SELECT=8 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:10:09.074739 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-9a20755c-6ccc-405f-9e29-ee0083ecbad2 req-f45808e0-5b3c-465f-93bc-ec2766a3003f service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:09.078471 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-9a20755c-6ccc-405f-9e29-ee0083ecbad2 req-f45808e0-5b3c-465f-93bc-ec2766a3003f service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:09.097633 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.compute.server_external_events [req-9a20755c-6ccc-405f-9e29-ee0083ecbad2 req-f45808e0-5b3c-465f-93bc-ec2766a3003f service nova] Creating event network-changed:6ba426b9-2ac4-463e-bc64-9ae379649087 for instance 979133c4-01ae-4510-8d70-018170135a6c on hv-cinder-83979 May 31 21:10:09.106194 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [req-9a20755c-6ccc-405f-9e29-ee0083ecbad2 req-f45808e0-5b3c-465f-93bc-ec2766a3003f service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050679 May 31 21:10:09.107008 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 371/711] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:10:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:10:09.199802 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-fb5b40dc-f4d4-4de0-927b-3a7a7a6e0ff3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:10:09.199802 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-fb5b40dc-f4d4-4de0-927b-3a7a7a6e0ff3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:10:09.206950 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-fb5b40dc-f4d4-4de0-927b-3a7a7a6e0ff3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:09.207954 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-fb5b40dc-f4d4-4de0-927b-3a7a7a6e0ff3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:09.208524 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-fb5b40dc-f4d4-4de0-927b-3a7a7a6e0ff3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:09.209222 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-fb5b40dc-f4d4-4de0-927b-3a7a7a6e0ff3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:09.250192 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-fb5b40dc-f4d4-4de0-927b-3a7a7a6e0ff3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd/os-volume_attachments/829bd895-8285-418d-8856-9fcb64fec960" status: 200 len: 194 microversion: 2.20 time: 0.056389 May 31 21:10:09.252018 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 341/712] 10.222.0.55 () {60 vars in 1453 bytes} [Tue May 31 21:10:09 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd/os-volume_attachments/829bd895-8285-418d-8856-9fcb64fec960 => generated 194 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 21:10:09.324394 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-c0add8b0-5872-44ed-acf5-ce2121331550 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:10:09.325220 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-c0add8b0-5872-44ed-acf5-ce2121331550 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:10:09.332051 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c0add8b0-5872-44ed-acf5-ce2121331550 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:09.332501 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c0add8b0-5872-44ed-acf5-ce2121331550 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:09.333465 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c0add8b0-5872-44ed-acf5-ce2121331550 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:09.334369 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c0add8b0-5872-44ed-acf5-ce2121331550 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:09.420117 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.objects.instance [None req-c0add8b0-5872-44ed-acf5-ce2121331550 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lazy-loading 'services' on Instance uuid a123764b-4693-41b1-bad8-a1a63cc951cd {{(pid=118184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 21:10:09.687718 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-c0add8b0-5872-44ed-acf5-ce2121331550 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "DELETE /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd/os-volume_attachments/829bd895-8285-418d-8856-9fcb64fec960" status: 202 len: 0 microversion: 2.20 time: 0.368547 May 31 21:10:09.692616 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 372/713] 10.222.0.55 () {60 vars in 1456 bytes} [Tue May 31 21:10:09 2022] DELETE /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd/os-volume_attachments/829bd895-8285-418d-8856-9fcb64fec960 => generated 0 bytes in 374 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 31 21:10:09.698059 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-1bee9c8b-3596-46af-9b93-073c22bb5c0f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:10:09.699744 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-1bee9c8b-3596-46af-9b93-073c22bb5c0f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:10:09.708638 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-1bee9c8b-3596-46af-9b93-073c22bb5c0f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:09.709345 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-1bee9c8b-3596-46af-9b93-073c22bb5c0f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:09.710159 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-1bee9c8b-3596-46af-9b93-073c22bb5c0f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:09.710594 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-1bee9c8b-3596-46af-9b93-073c22bb5c0f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:09.745605 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-1bee9c8b-3596-46af-9b93-073c22bb5c0f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051991 May 31 21:10:09.747026 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 342/714] 10.222.0.55 () {60 vars in 1342 bytes} [Tue May 31 21:10:09 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 21:10:10.762986 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-0ad1d50c-5428-42e9-a9c9-c8af8b253a4a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:10:10.768545 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-0ad1d50c-5428-42e9-a9c9-c8af8b253a4a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:10:10.775416 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-0ad1d50c-5428-42e9-a9c9-c8af8b253a4a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:10.776115 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-0ad1d50c-5428-42e9-a9c9-c8af8b253a4a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:10.777356 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-0ad1d50c-5428-42e9-a9c9-c8af8b253a4a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:10.778053 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-0ad1d50c-5428-42e9-a9c9-c8af8b253a4a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:10.779936 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-bff44e28-83ba-42df-9474-c982da61c217 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:10:10.780864 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-bff44e28-83ba-42df-9474-c982da61c217 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:10:10.790850 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-bff44e28-83ba-42df-9474-c982da61c217 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:10.792076 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-bff44e28-83ba-42df-9474-c982da61c217 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:10.793688 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-bff44e28-83ba-42df-9474-c982da61c217 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:10.794659 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-bff44e28-83ba-42df-9474-c982da61c217 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:10.945531 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.objects.instance [None req-bff44e28-83ba-42df-9474-c982da61c217 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lazy-loading 'services' on Instance uuid 979133c4-01ae-4510-8d70-018170135a6c {{(pid=118184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 21:10:11.037724 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-0ad1d50c-5428-42e9-a9c9-c8af8b253a4a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.282517 May 31 21:10:11.038531 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 343/715] 10.222.0.55 () {60 vars in 1342 bytes} [Tue May 31 21:10:10 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd/os-volume_attachments => generated 25 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:10:11.097574 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-09e6d331-1214-418c-b187-6858ec5956ce tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:10:11.098121 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-09e6d331-1214-418c-b187-6858ec5956ce tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:10:11.104205 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-09e6d331-1214-418c-b187-6858ec5956ce tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:11.104659 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-09e6d331-1214-418c-b187-6858ec5956ce tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:11.105432 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-09e6d331-1214-418c-b187-6858ec5956ce tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:11.105874 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-09e6d331-1214-418c-b187-6858ec5956ce tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:11.132512 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-09e6d331-1214-418c-b187-6858ec5956ce tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Going to try to terminate instance {{(pid=118185) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 21:10:11.213171 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-bff44e28-83ba-42df-9474-c982da61c217 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "DELETE /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c/os-volume_attachments/b93bf48a-335c-4340-8610-1bcaaaa7c123" status: 202 len: 0 microversion: 2.1 time: 0.547348 May 31 21:10:11.217060 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 373/716] 10.222.0.55 () {58 vars in 1415 bytes} [Tue May 31 21:10:10 2022] DELETE /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c/os-volume_attachments/b93bf48a-335c-4340-8610-1bcaaaa7c123 => generated 0 bytes in 549 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 21:10:11.219671 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [req-7ddcf26f-116a-4cd0-980b-54ba1f0225cd req-a6004538-b4c9-47f0-a94d-3f148e7082f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "979133c4-01ae-4510-8d70-018170135a6c", "tag": "6ba426b9-2ac4-463e-bc64-9ae379649087"}]} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:10:11.229109 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-7ddcf26f-116a-4cd0-980b-54ba1f0225cd req-a6004538-b4c9-47f0-a94d-3f148e7082f4 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:11.229641 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-7ddcf26f-116a-4cd0-980b-54ba1f0225cd req-a6004538-b4c9-47f0-a94d-3f148e7082f4 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:11.240849 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.compute.server_external_events [req-7ddcf26f-116a-4cd0-980b-54ba1f0225cd req-a6004538-b4c9-47f0-a94d-3f148e7082f4 service nova] Creating event network-changed:6ba426b9-2ac4-463e-bc64-9ae379649087 for instance 979133c4-01ae-4510-8d70-018170135a6c on hv-cinder-83979 May 31 21:10:11.245876 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [req-7ddcf26f-116a-4cd0-980b-54ba1f0225cd req-a6004538-b4c9-47f0-a94d-3f148e7082f4 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030521 May 31 21:10:11.246687 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 374/717] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:10:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:10:11.251754 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-6b957287-ddee-4572-89c4-e4b4fde39cdc tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:10:11.252988 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-6b957287-ddee-4572-89c4-e4b4fde39cdc tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:10:11.259687 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6b957287-ddee-4572-89c4-e4b4fde39cdc tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:11.260383 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6b957287-ddee-4572-89c4-e4b4fde39cdc tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:11.261331 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6b957287-ddee-4572-89c4-e4b4fde39cdc tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:11.261941 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6b957287-ddee-4572-89c4-e4b4fde39cdc tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:11.293729 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-6b957287-ddee-4572-89c4-e4b4fde39cdc tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045877 May 31 21:10:11.294577 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 375/718] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 31 21:10:11 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:10:11.470489 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-09e6d331-1214-418c-b187-6858ec5956ce tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "DELETE /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 204 len: 0 microversion: 2.20 time: 0.371337 May 31 21:10:11.470489 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 344/719] 10.222.0.55 () {60 vars in 1279 bytes} [Tue May 31 21:10:11 2022] DELETE /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 31 21:10:11.475149 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-3cbf17ee-6275-41a0-9e7c-0f98e45756d2 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:10:11.475867 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-3cbf17ee-6275-41a0-9e7c-0f98e45756d2 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:10:11.482082 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-3cbf17ee-6275-41a0-9e7c-0f98e45756d2 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:11.482529 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-3cbf17ee-6275-41a0-9e7c-0f98e45756d2 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:11.483290 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-3cbf17ee-6275-41a0-9e7c-0f98e45756d2 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:11.483730 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-3cbf17ee-6275-41a0-9e7c-0f98e45756d2 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:11.621070 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-3cbf17ee-6275-41a0-9e7c-0f98e45756d2 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:10:11.629484 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-3cbf17ee-6275-41a0-9e7c-0f98e45756d2 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:10:11.631087 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-3cbf17ee-6275-41a0-9e7c-0f98e45756d2 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:10:11.632259 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-3cbf17ee-6275-41a0-9e7c-0f98e45756d2 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1723 microversion: 2.20 time: 0.162013 May 31 21:10:11.632819 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 376/720] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:10:11 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:10:12.306503 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-6a9d9db9-ab45-443d-b7c9-b72803e6e397 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:10:12.307576 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-6a9d9db9-ab45-443d-b7c9-b72803e6e397 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:10:12.314053 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-6a9d9db9-ab45-443d-b7c9-b72803e6e397 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:12.314505 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-6a9d9db9-ab45-443d-b7c9-b72803e6e397 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:12.315273 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-6a9d9db9-ab45-443d-b7c9-b72803e6e397 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:12.315710 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-6a9d9db9-ab45-443d-b7c9-b72803e6e397 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:12.343784 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-6a9d9db9-ab45-443d-b7c9-b72803e6e397 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041615 May 31 21:10:12.344333 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 345/721] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 31 21:10:12 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:10:12.650931 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-46410ca7-d202-4ace-9c72-f02db03b8c0e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:10:12.651476 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-46410ca7-d202-4ace-9c72-f02db03b8c0e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:10:12.658237 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-46410ca7-d202-4ace-9c72-f02db03b8c0e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:12.658682 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-46410ca7-d202-4ace-9c72-f02db03b8c0e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:12.659445 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-46410ca7-d202-4ace-9c72-f02db03b8c0e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:12.659881 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-46410ca7-d202-4ace-9c72-f02db03b8c0e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:12.791479 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-46410ca7-d202-4ace-9c72-f02db03b8c0e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:10:12.800242 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-46410ca7-d202-4ace-9c72-f02db03b8c0e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:10:12.801742 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-46410ca7-d202-4ace-9c72-f02db03b8c0e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:10:12.802926 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-46410ca7-d202-4ace-9c72-f02db03b8c0e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1723 microversion: 2.20 time: 0.156143 May 31 21:10:12.804013 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 377/722] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:10:12 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:10:13.357437 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-8b0e2b38-f580-490b-83cb-3d4a3a424f3f tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:10:13.358566 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-8b0e2b38-f580-490b-83cb-3d4a3a424f3f tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:10:13.366386 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-8b0e2b38-f580-490b-83cb-3d4a3a424f3f tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:13.367177 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-8b0e2b38-f580-490b-83cb-3d4a3a424f3f tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:13.367752 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-8b0e2b38-f580-490b-83cb-3d4a3a424f3f tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:13.368113 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-8b0e2b38-f580-490b-83cb-3d4a3a424f3f tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:13.398280 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-8b0e2b38-f580-490b-83cb-3d4a3a424f3f tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045897 May 31 21:10:13.399068 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 346/723] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 31 21:10:13 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:10:13.820686 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-99af40a0-1a53-41ed-a79e-305c86f34041 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:10:13.821285 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-99af40a0-1a53-41ed-a79e-305c86f34041 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:10:13.827937 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-99af40a0-1a53-41ed-a79e-305c86f34041 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:13.828385 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-99af40a0-1a53-41ed-a79e-305c86f34041 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:13.829204 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-99af40a0-1a53-41ed-a79e-305c86f34041 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:13.832971 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-99af40a0-1a53-41ed-a79e-305c86f34041 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:13.961924 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-99af40a0-1a53-41ed-a79e-305c86f34041 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:10:13.970108 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-99af40a0-1a53-41ed-a79e-305c86f34041 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:10:13.971608 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-99af40a0-1a53-41ed-a79e-305c86f34041 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:10:13.972773 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-99af40a0-1a53-41ed-a79e-305c86f34041 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1723 microversion: 2.20 time: 0.156069 May 31 21:10:13.973334 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 378/724] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:10:13 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:10:14.410442 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-4e2e3094-7a26-4553-9866-cc785665cb4f tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:10:14.411416 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-4e2e3094-7a26-4553-9866-cc785665cb4f tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:10:14.417765 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4e2e3094-7a26-4553-9866-cc785665cb4f tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:14.427016 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4e2e3094-7a26-4553-9866-cc785665cb4f tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:14.427016 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4e2e3094-7a26-4553-9866-cc785665cb4f tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:14.427016 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4e2e3094-7a26-4553-9866-cc785665cb4f tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:14.447339 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-4e2e3094-7a26-4553-9866-cc785665cb4f tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041515 May 31 21:10:14.447891 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 347/725] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 31 21:10:14 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 31 21:10:14.458543 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-4074fd34-b226-4eba-8e00-d88598817f15 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:10:14.459299 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-4074fd34-b226-4eba-8e00-d88598817f15 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:10:14.465324 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4074fd34-b226-4eba-8e00-d88598817f15 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:14.465782 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4074fd34-b226-4eba-8e00-d88598817f15 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:14.466596 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4074fd34-b226-4eba-8e00-d88598817f15 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:14.467038 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4074fd34-b226-4eba-8e00-d88598817f15 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:14.554124 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.wsgi [None req-4074fd34-b226-4eba-8e00-d88598817f15 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] HTTP exception thrown: Instance 979133c4-01ae-4510-8d70-018170135a6c is not attached to volume b93bf48a-335c-4340-8610-1bcaaaa7c123 May 31 21:10:14.572869 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-4074fd34-b226-4eba-8e00-d88598817f15 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Request method failure captured: May 31 21:10:14.572869 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: request: DELETE /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c/os-volume_attachments/b93bf48a-335c-4340-8610-1bcaaaa7c123 HTTP/1.1 May 31 21:10:14.572869 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Accept: application/json May 31 21:10:14.572869 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Accept-Encoding: identity May 31 21:10:14.572869 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Connection: close May 31 21:10:14.572869 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Content-Length: 0 May 31 21:10:14.572869 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Content-Type: application/json May 31 21:10:14.572869 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Host: 10.222.0.55 May 31 21:10:14.572869 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Openstack-System-Scope: None May 31 21:10:14.572869 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: User-Agent: python-urllib3/1.26.9 May 31 21:10:14.572869 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Auth-Token: gAAAAABiloL6oHGktZOO_fKOpdqYlIe8QLP1Ord7SLDae_zwvL2Ix01Lspgtx33Ijt1WSCWMp7-xXmqT9Z3uc2Z7I72dle8Mr4_XiO8UdNpuZYti7XGAnXu656z0ZTdaTJy0mdLAgDpkB_8HcqqeoX0a_E0KMU01O79fgLP8Q8v_kfro9salFdU May 31 21:10:14.572869 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Domain-Id: None May 31 21:10:14.572869 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Domain-Name: None May 31 21:10:14.572869 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Identity-Status: Confirmed May 31 21:10:14.572869 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Is-Admin-Project: True May 31 21:10:14.572869 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Domain-Id: default May 31 21:10:14.572869 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Domain-Name: Default May 31 21:10:14.572869 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Id: 9f9ac73d84244b1c9029586fa4969bbf May 31 21:10:14.572869 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Name: tempest-TestMinimumBasicScenario-1603848848 May 31 21:10:14.572869 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Role: member,reader May 31 21:10:14.572869 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Roles: member,reader May 31 21:10:14.580389 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/9f9ac73d84244b1c9029586fa4969bbf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9f9ac73d84244b1c9029586fa4969bbf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_9f9ac73d84244b1c9029586fa4969bbf", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9f9ac73d84244b1c9029586fa4969bbf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] May 31 21:10:14.580389 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant: tempest-TestMinimumBasicScenario-1603848848 May 31 21:10:14.580389 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant-Id: 9f9ac73d84244b1c9029586fa4969bbf May 31 21:10:14.580389 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1603848848 May 31 21:10:14.580389 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User: tempest-TestMinimumBasicScenario-1603848848-project May 31 21:10:14.580389 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Domain-Id: default May 31 21:10:14.580389 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Domain-Name: Default May 31 21:10:14.580389 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Id: 107ed6d5d4524a29a1c545cba5e8f5bf May 31 21:10:14.580389 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Name: tempest-TestMinimumBasicScenario-1603848848-project May 31 21:10:14.580389 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: method: > May 31 21:10:14.580389 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: exception: Instance 979133c4-01ae-4510-8d70-018170135a6c is not attached to volume b93bf48a-335c-4340-8610-1bcaaaa7c123 May 31 21:10:14.581288 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: action_args: {'server_id': '979133c4-01ae-4510-8d70-018170135a6c', 'id': 'b93bf48a-335c-4340-8610-1bcaaaa7c123'} May 31 21:10:14.581288 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 21:10:14.581288 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:10:14.581288 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 31 21:10:14.581288 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 31 21:10:14.581288 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 31 21:10:14.581288 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 31 21:10:14.581288 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 31 21:10:14.581288 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 31 21:10:14.581288 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id b93bf48a-335c-4340-8610-1bcaaaa7c123. May 31 21:10:14.581288 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:10:14.581288 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:10:14.581288 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:10:14.581288 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:10:14.581288 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:10:14.581288 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:10:14.581288 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 21:10:14.581288 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 21:10:14.581288 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 21:10:14.582904 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 21:10:14.582904 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 31 21:10:14.582904 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 31 21:10:14.582904 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 979133c4-01ae-4510-8d70-018170135a6c is not attached to volume b93bf48a-335c-4340-8610-1bcaaaa7c123 May 31 21:10:14.582904 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:10:14.582904 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:10:14.582904 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:10:14.582904 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:10:14.582904 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:10:14.582904 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:10:14.582904 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 21:10:14.582904 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 21:10:14.582904 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 979133c4-01ae-4510-8d70-018170135a6c is not attached to volume b93bf48a-335c-4340-8610-1bcaaaa7c123 May 31 21:10:14.582904 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:10:14.582904 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-4074fd34-b226-4eba-8e00-d88598817f15 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Returning 404 to user: Instance 979133c4-01ae-4510-8d70-018170135a6c is not attached to volume b93bf48a-335c-4340-8610-1bcaaaa7c123 {{(pid=118184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 21:10:14.584777 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-4074fd34-b226-4eba-8e00-d88598817f15 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "DELETE /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c/os-volume_attachments/b93bf48a-335c-4340-8610-1bcaaaa7c123" status: 404 len: 154 microversion: 2.1 time: 0.120791 May 31 21:10:14.584777 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 379/726] 10.222.0.55 () {58 vars in 1415 bytes} [Tue May 31 21:10:14 2022] DELETE /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c/os-volume_attachments/b93bf48a-335c-4340-8610-1bcaaaa7c123 => generated 154 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 31 21:10:14.998329 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-6d364cdd-ad70-4564-bdf7-6434d26c24ed tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:10:15.000351 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-6d364cdd-ad70-4564-bdf7-6434d26c24ed tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:10:15.013378 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6d364cdd-ad70-4564-bdf7-6434d26c24ed tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:15.013830 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6d364cdd-ad70-4564-bdf7-6434d26c24ed tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:15.014865 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6d364cdd-ad70-4564-bdf7-6434d26c24ed tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:15.015458 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6d364cdd-ad70-4564-bdf7-6434d26c24ed tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:15.061508 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [req-c4e6fa01-0c03-4aeb-9268-a468b9ac8179 req-92bbda3c-6566-4ffd-91d9-99a8594a29ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a123764b-4693-41b1-bad8-a1a63cc951cd", "name": "network-vif-deleted", "tag": "cc0edf95-fc02-451a-b38f-075bee275ed6"}]} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:10:15.072449 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-c4e6fa01-0c03-4aeb-9268-a468b9ac8179 req-92bbda3c-6566-4ffd-91d9-99a8594a29ac service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:15.072885 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-c4e6fa01-0c03-4aeb-9268-a468b9ac8179 req-92bbda3c-6566-4ffd-91d9-99a8594a29ac service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:15.085263 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.compute.server_external_events [req-c4e6fa01-0c03-4aeb-9268-a468b9ac8179 req-92bbda3c-6566-4ffd-91d9-99a8594a29ac service nova] Creating event network-vif-deleted:cc0edf95-fc02-451a-b38f-075bee275ed6 for instance a123764b-4693-41b1-bad8-a1a63cc951cd on hv-cinder-83979 May 31 21:10:15.092105 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [req-c4e6fa01-0c03-4aeb-9268-a468b9ac8179 req-92bbda3c-6566-4ffd-91d9-99a8594a29ac service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111609 May 31 21:10:15.095549 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 348/727] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:10:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:10:15.097058 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-6d364cdd-ad70-4564-bdf7-6434d26c24ed tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:10:15.106205 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-6d364cdd-ad70-4564-bdf7-6434d26c24ed tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:10:15.107670 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-6d364cdd-ad70-4564-bdf7-6434d26c24ed tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:10:15.109098 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-6d364cdd-ad70-4564-bdf7-6434d26c24ed tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 200 len: 1655 microversion: 2.20 time: 0.121480 May 31 21:10:15.110154 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 380/728] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:10:14 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 1655 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:10:15.896153 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-b91e4e11-0e8f-4e89-a815-3e9be0d350eb tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:10:15.896819 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-b91e4e11-0e8f-4e89-a815-3e9be0d350eb tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:10:15.903743 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b91e4e11-0e8f-4e89-a815-3e9be0d350eb tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:15.907668 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b91e4e11-0e8f-4e89-a815-3e9be0d350eb tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:15.907668 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b91e4e11-0e8f-4e89-a815-3e9be0d350eb tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:15.907668 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b91e4e11-0e8f-4e89-a815-3e9be0d350eb tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:15.932637 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-b91e4e11-0e8f-4e89-a815-3e9be0d350eb tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Going to try to terminate instance {{(pid=118185) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 21:10:16.128435 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-eedbc7d8-265e-47d3-b40f-9b4d3c594d2c tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:10:16.129043 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-eedbc7d8-265e-47d3-b40f-9b4d3c594d2c tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:10:16.139333 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-eedbc7d8-265e-47d3-b40f-9b4d3c594d2c tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:16.139783 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-eedbc7d8-265e-47d3-b40f-9b4d3c594d2c tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:16.140619 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-eedbc7d8-265e-47d3-b40f-9b4d3c594d2c tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:16.141054 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-eedbc7d8-265e-47d3-b40f-9b4d3c594d2c tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:16.160738 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.wsgi [None req-eedbc7d8-265e-47d3-b40f-9b4d3c594d2c tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] HTTP exception thrown: Instance a123764b-4693-41b1-bad8-a1a63cc951cd could not be found. May 31 21:10:16.162533 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-eedbc7d8-265e-47d3-b40f-9b4d3c594d2c tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Request method failure captured: May 31 21:10:16.162533 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: request: GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd HTTP/1.1 May 31 21:10:16.162533 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Accept: application/json May 31 21:10:16.162533 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Accept-Encoding: identity May 31 21:10:16.162533 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Connection: close May 31 21:10:16.162533 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Content-Length: 0 May 31 21:10:16.162533 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Content-Type: application/json May 31 21:10:16.162533 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Host: 10.222.0.55 May 31 21:10:16.162533 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Openstack-System-Scope: None May 31 21:10:16.162533 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: User-Agent: python-urllib3/1.26.9 May 31 21:10:16.162533 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Auth-Token: gAAAAABiloKnJ_2lcEUHBtqGonwFAPKRN4u6Jj98V992qyB0RgFvh645yLhj_58i3K3xDrLOaAAGNimOespdwH_ZYG39Jef0nTIRBuLPvIp-1Cg1Jsm5xXNNM1pUdYoFw8vP7YFqBeGsVa011fgNOghwwGaORJ5Bk8xEcqBovJ_HNYR4r3OFkyg May 31 21:10:16.162533 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Domain-Id: None May 31 21:10:16.162533 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Domain-Name: None May 31 21:10:16.162533 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Identity-Status: Confirmed May 31 21:10:16.162533 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Is-Admin-Project: True May 31 21:10:16.162533 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Openstack-Nova-Api-Version: 2.20 May 31 21:10:16.162533 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Domain-Id: default May 31 21:10:16.162533 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Domain-Name: Default May 31 21:10:16.162533 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Id: af420d43367c42e4a4b0948706dd0546 May 31 21:10:16.162533 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-861773528 May 31 21:10:16.162533 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Role: member,reader May 31 21:10:16.162533 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Roles: member,reader May 31 21:10:16.168879 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/af420d43367c42e4a4b0948706dd0546"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/af420d43367c42e4a4b0948706dd0546"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_af420d43367c42e4a4b0948706dd0546", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/af420d43367c42e4a4b0948706dd0546"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] May 31 21:10:16.168879 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant: tempest-AttachVolumeShelveTestJSON-861773528 May 31 21:10:16.168879 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant-Id: af420d43367c42e4a4b0948706dd0546 May 31 21:10:16.168879 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-861773528 May 31 21:10:16.168879 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User: tempest-AttachVolumeShelveTestJSON-861773528-project May 31 21:10:16.168879 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Domain-Id: default May 31 21:10:16.168879 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Domain-Name: Default May 31 21:10:16.168879 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Id: 2d69edafe80649d4aff602b692e294c8 May 31 21:10:16.168879 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Name: tempest-AttachVolumeShelveTestJSON-861773528-project May 31 21:10:16.168879 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: method: > May 31 21:10:16.168879 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: exception: Instance a123764b-4693-41b1-bad8-a1a63cc951cd could not be found. May 31 21:10:16.168879 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: action_args: {'id': 'a123764b-4693-41b1-bad8-a1a63cc951cd'} May 31 21:10:16.169838 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 21:10:16.169838 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:10:16.169838 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 21:10:16.169838 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 21:10:16.169838 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 21:10:16.169838 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 21:10:16.169838 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 21:10:16.169838 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 21:10:16.169838 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 21:10:16.169838 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 21:10:16.169838 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a123764b-4693-41b1-bad8-a1a63cc951cd could not be found. May 31 21:10:16.169838 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:10:16.169838 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:10:16.169838 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:10:16.169838 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:10:16.169838 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:10:16.169838 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:10:16.169838 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 21:10:16.169838 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 21:10:16.169838 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 21:10:16.171344 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 21:10:16.171344 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 21:10:16.171344 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 21:10:16.171344 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 21:10:16.171344 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 21:10:16.171344 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 21:10:16.171344 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 21:10:16.171344 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a123764b-4693-41b1-bad8-a1a63cc951cd could not be found. May 31 21:10:16.171344 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:10:16.171344 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:10:16.171344 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:10:16.171344 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:10:16.171344 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:10:16.171344 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:10:16.171344 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 21:10:16.171344 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 21:10:16.171344 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a123764b-4693-41b1-bad8-a1a63cc951cd could not be found. May 31 21:10:16.171344 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:10:16.172651 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-eedbc7d8-265e-47d3-b40f-9b4d3c594d2c tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Returning 404 to user: Instance a123764b-4693-41b1-bad8-a1a63cc951cd could not be found. {{(pid=118184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 21:10:16.172651 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-eedbc7d8-265e-47d3-b40f-9b4d3c594d2c tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 404 len: 111 microversion: 2.20 time: 0.039705 May 31 21:10:16.172651 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 381/729] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:10:16 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 31 21:10:16.178510 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-bc688319-3ae8-4e04-9e7b-8e7ca9dd5ca2 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '.version_select at 0x7fe7c0d508b0>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:10:16.300144 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-b91e4e11-0e8f-4e89-a815-3e9be0d350eb tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "DELETE /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 204 len: 0 microversion: 2.1 time: 0.407994 May 31 21:10:16.300742 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 349/730] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 31 21:10:15 2022] DELETE /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 31 21:10:16.307314 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-bc688319-3ae8-4e04-9e7b-8e7ca9dd5ca2 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-836839230" status: 204 len: 0 microversion: 2.20 time: 0.128024 May 31 21:10:16.307314 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 382/731] 10.222.0.55 () {60 vars in 1258 bytes} [Tue May 31 21:10:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-836839230 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 31 21:10:16.310142 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-84248dfd-5c2c-430a-b341-99bd1516b3a3 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:10:16.310323 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-84248dfd-5c2c-430a-b341-99bd1516b3a3 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:10:16.318299 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-84248dfd-5c2c-430a-b341-99bd1516b3a3 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:16.318758 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-84248dfd-5c2c-430a-b341-99bd1516b3a3 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:16.319606 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-84248dfd-5c2c-430a-b341-99bd1516b3a3 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:16.319990 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-84248dfd-5c2c-430a-b341-99bd1516b3a3 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:16.509707 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-84248dfd-5c2c-430a-b341-99bd1516b3a3 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:10:16.518339 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-84248dfd-5c2c-430a-b341-99bd1516b3a3 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1553 microversion: 2.1 time: 0.213160 May 31 21:10:16.519306 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 383/732] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:10:16 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1553 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:10:17.225316 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-62dce08b-6df4-4eda-8017-c7f7217d0fe2 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Action: 'create', calling method: .version_select at 0x7fe7c0cf0280>, body: {"keypair": {"name": "tempest-keypair-4258349", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKmGYqZ7EHlyWq6/zPEP1R8IdhYKaTpgEhNIimMj3ujLaX+Sr8JuvDYwkTSXoywHBOm+3gxvvjAULlaId6nr5K3EK5tpJajtNixsNfJ1jNXGLGEM7OJ9AqTizROmlk4VtQ=="}} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:10:17.240861 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.quota [None req-62dce08b-6df4-4eda-8017-c7f7217d0fe2 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Getting quotas for project af420d43367c42e4a4b0948706dd0546. Resources: {'key_pairs'} {{(pid=118185) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 21:10:17.244825 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.quota [None req-62dce08b-6df4-4eda-8017-c7f7217d0fe2 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Getting quotas for user 2d69edafe80649d4aff602b692e294c8 and project af420d43367c42e4a4b0948706dd0546. Resources: {'key_pairs'} {{(pid=118185) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 21:10:17.373518 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-62dce08b-6df4-4eda-8017-c7f7217d0fe2 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 201 len: 398 microversion: 2.20 time: 0.152474 May 31 21:10:17.374072 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 350/733] 10.222.0.55 () {62 vars in 1199 bytes} [Tue May 31 21:10:17 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 154 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) May 31 21:10:17.536275 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-cbea6d12-9fa9-425c-98ab-e70311748ab0 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:10:17.536902 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-cbea6d12-9fa9-425c-98ab-e70311748ab0 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:10:17.546986 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-cbea6d12-9fa9-425c-98ab-e70311748ab0 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:17.547532 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-cbea6d12-9fa9-425c-98ab-e70311748ab0 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:17.548969 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-cbea6d12-9fa9-425c-98ab-e70311748ab0 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:17.550117 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-cbea6d12-9fa9-425c-98ab-e70311748ab0 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:17.725964 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-cbea6d12-9fa9-425c-98ab-e70311748ab0 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:10:17.733823 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-cbea6d12-9fa9-425c-98ab-e70311748ab0 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1553 microversion: 2.1 time: 0.201862 May 31 21:10:17.734441 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 384/734] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:10:17 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1553 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:10:18.753637 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-4f5ac5bc-1919-44d9-be02-19864648e7fe tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:10:18.754344 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-4f5ac5bc-1919-44d9-be02-19864648e7fe tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:10:18.760567 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4f5ac5bc-1919-44d9-be02-19864648e7fe tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:18.762288 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4f5ac5bc-1919-44d9-be02-19864648e7fe tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:18.762288 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4f5ac5bc-1919-44d9-be02-19864648e7fe tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:18.762951 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4f5ac5bc-1919-44d9-be02-19864648e7fe tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:19.013011 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-4f5ac5bc-1919-44d9-be02-19864648e7fe tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107ed6d5d4524a29a1c545cba5e8f5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9ac73d84244b1c9029586fa4969bbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:10:19.017818 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [req-9499d9e1-e1d5-47cc-973d-5ca9074a0942 req-17028612-96a0-4d6c-a663-f4a72be7ad28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "979133c4-01ae-4510-8d70-018170135a6c", "name": "network-vif-deleted", "tag": "6ba426b9-2ac4-463e-bc64-9ae379649087"}]} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:10:19.024207 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-4f5ac5bc-1919-44d9-be02-19864648e7fe tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 200 len: 1553 microversion: 2.1 time: 0.275861 May 31 21:10:19.025401 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 351/735] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:10:18 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 1553 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:10:19.026501 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-9499d9e1-e1d5-47cc-973d-5ca9074a0942 req-17028612-96a0-4d6c-a663-f4a72be7ad28 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:19.026950 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-9499d9e1-e1d5-47cc-973d-5ca9074a0942 req-17028612-96a0-4d6c-a663-f4a72be7ad28 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:19.038802 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.compute.server_external_events [req-9499d9e1-e1d5-47cc-973d-5ca9074a0942 req-17028612-96a0-4d6c-a663-f4a72be7ad28 service nova] Creating event network-vif-deleted:6ba426b9-2ac4-463e-bc64-9ae379649087 for instance 979133c4-01ae-4510-8d70-018170135a6c on hv-cinder-83979 May 31 21:10:19.043970 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [req-9499d9e1-e1d5-47cc-973d-5ca9074a0942 req-17028612-96a0-4d6c-a663-f4a72be7ad28 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030671 May 31 21:10:19.044740 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 385/736] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:10:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 21:10:19.880715 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-f97f8375-14e7-4098-8783-450b33273982 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-413474958", "imageRef": "21b89996-9e87-489d-8891-305f6c3d905a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "68e327a3-96b2-4add-895f-c43a3d5daedc"}], "security_groups": [{"name": "tempest-securitygroup--828799658"}], "key_name": "tempest-keypair-4258349", "user_data": "}} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:10:19.986992 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.network.neutron [None req-f97f8375-14e7-4098-8783-450b33273982 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] validate_networks() for [('68e327a3-96b2-4add-895f-c43a3d5daedc', None, None, None, None, None)] {{(pid=118185) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 21:10:20.044986 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-4cef0675-41c3-4174-91de-15704f0be550 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:10:20.045602 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-4cef0675-41c3-4174-91de-15704f0be550 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] [instance: 979133c4-01ae-4510-8d70-018170135a6c] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:10:20.053348 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4cef0675-41c3-4174-91de-15704f0be550 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:20.053793 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4cef0675-41c3-4174-91de-15704f0be550 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:20.054588 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4cef0675-41c3-4174-91de-15704f0be550 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:20.055017 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4cef0675-41c3-4174-91de-15704f0be550 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:20.068408 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.wsgi [None req-4cef0675-41c3-4174-91de-15704f0be550 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] HTTP exception thrown: Instance 979133c4-01ae-4510-8d70-018170135a6c could not be found. May 31 21:10:20.070108 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-4cef0675-41c3-4174-91de-15704f0be550 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Request method failure captured: May 31 21:10:20.070108 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: request: GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c HTTP/1.1 May 31 21:10:20.070108 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Accept: application/json May 31 21:10:20.070108 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Accept-Encoding: identity May 31 21:10:20.070108 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Connection: close May 31 21:10:20.070108 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Content-Length: 0 May 31 21:10:20.070108 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Content-Type: application/json May 31 21:10:20.070108 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Host: 10.222.0.55 May 31 21:10:20.070108 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Openstack-System-Scope: None May 31 21:10:20.070108 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: User-Agent: python-urllib3/1.26.9 May 31 21:10:20.070108 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Auth-Token: gAAAAABiloL6oHGktZOO_fKOpdqYlIe8QLP1Ord7SLDae_zwvL2Ix01Lspgtx33Ijt1WSCWMp7-xXmqT9Z3uc2Z7I72dle8Mr4_XiO8UdNpuZYti7XGAnXu656z0ZTdaTJy0mdLAgDpkB_8HcqqeoX0a_E0KMU01O79fgLP8Q8v_kfro9salFdU May 31 21:10:20.070108 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Domain-Id: None May 31 21:10:20.070108 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Domain-Name: None May 31 21:10:20.070108 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Identity-Status: Confirmed May 31 21:10:20.070108 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Is-Admin-Project: True May 31 21:10:20.070108 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Domain-Id: default May 31 21:10:20.070108 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Domain-Name: Default May 31 21:10:20.070108 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Id: 9f9ac73d84244b1c9029586fa4969bbf May 31 21:10:20.070108 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Name: tempest-TestMinimumBasicScenario-1603848848 May 31 21:10:20.070108 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Role: member,reader May 31 21:10:20.070108 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Roles: member,reader May 31 21:10:20.071653 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/9f9ac73d84244b1c9029586fa4969bbf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9f9ac73d84244b1c9029586fa4969bbf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_9f9ac73d84244b1c9029586fa4969bbf", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9f9ac73d84244b1c9029586fa4969bbf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] May 31 21:10:20.071653 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant: tempest-TestMinimumBasicScenario-1603848848 May 31 21:10:20.071653 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant-Id: 9f9ac73d84244b1c9029586fa4969bbf May 31 21:10:20.071653 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1603848848 May 31 21:10:20.071653 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User: tempest-TestMinimumBasicScenario-1603848848-project May 31 21:10:20.071653 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Domain-Id: default May 31 21:10:20.071653 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Domain-Name: Default May 31 21:10:20.071653 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Id: 107ed6d5d4524a29a1c545cba5e8f5bf May 31 21:10:20.071653 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Name: tempest-TestMinimumBasicScenario-1603848848-project May 31 21:10:20.071653 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: method: > May 31 21:10:20.071653 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: exception: Instance 979133c4-01ae-4510-8d70-018170135a6c could not be found. May 31 21:10:20.071653 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: action_args: {'id': '979133c4-01ae-4510-8d70-018170135a6c'} May 31 21:10:20.072545 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 21:10:20.072545 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:10:20.072545 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 21:10:20.072545 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 21:10:20.072545 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 21:10:20.072545 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 21:10:20.072545 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 21:10:20.072545 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 21:10:20.072545 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 21:10:20.072545 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 21:10:20.072545 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 979133c4-01ae-4510-8d70-018170135a6c could not be found. May 31 21:10:20.072545 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:10:20.072545 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:10:20.072545 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:10:20.072545 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:10:20.072545 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:10:20.072545 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:10:20.072545 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 21:10:20.072545 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 21:10:20.072545 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 21:10:20.074163 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 21:10:20.074163 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 21:10:20.074163 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 21:10:20.074163 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 21:10:20.074163 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 21:10:20.074163 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 21:10:20.074163 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 21:10:20.074163 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 979133c4-01ae-4510-8d70-018170135a6c could not be found. May 31 21:10:20.074163 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:10:20.074163 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:10:20.074163 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:10:20.074163 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:10:20.074163 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:10:20.074163 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:10:20.074163 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 21:10:20.074163 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 21:10:20.074163 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 979133c4-01ae-4510-8d70-018170135a6c could not be found. May 31 21:10:20.074163 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:10:20.075683 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-4cef0675-41c3-4174-91de-15704f0be550 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Returning 404 to user: Instance 979133c4-01ae-4510-8d70-018170135a6c could not be found. {{(pid=118184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 21:10:20.075683 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-4cef0675-41c3-4174-91de-15704f0be550 tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c" status: 404 len: 111 microversion: 2.1 time: 0.031731 May 31 21:10:20.075683 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 386/737] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:10:20 2022] GET /compute/v2.1/servers/979133c4-01ae-4510-8d70-018170135a6c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 31 21:10:20.080465 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-4025214e-58fd-496a-8c6b-a220fe14622b tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] Calling method '.version_select at 0x7fe7c0cca670>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:10:20.178391 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-4025214e-58fd-496a-8c6b-a220fe14622b tempest-TestMinimumBasicScenario-1603848848 tempest-TestMinimumBasicScenario-1603848848-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-977709738" status: 202 len: 0 microversion: 2.1 time: 0.102035 May 31 21:10:20.178976 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 387/738] 10.222.0.55 () {58 vars in 1268 bytes} [Tue May 31 21:10:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-977709738 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 21:10:20.365614 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.virt.hardware [None req-f97f8375-14e7-4098-8783-450b33273982 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Flavor limits 0:0:0 {{(pid=118185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 21:10:20.366317 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.virt.hardware [None req-f97f8375-14e7-4098-8783-450b33273982 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Image limits 0:0:0 {{(pid=118185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 21:10:20.370506 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.virt.hardware [None req-f97f8375-14e7-4098-8783-450b33273982 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Flavor pref 0:0:0 {{(pid=118185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 21:10:20.370506 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.virt.hardware [None req-f97f8375-14e7-4098-8783-450b33273982 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Image pref 0:0:0 {{(pid=118185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 21:10:20.370506 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.virt.hardware [None req-f97f8375-14e7-4098-8783-450b33273982 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 21:10:20.377817 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f97f8375-14e7-4098-8783-450b33273982 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:20.378344 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f97f8375-14e7-4098-8783-450b33273982 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:20.379137 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f97f8375-14e7-4098-8783-450b33273982 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:20.379573 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f97f8375-14e7-4098-8783-450b33273982 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:20.397054 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.quota [None req-f97f8375-14e7-4098-8783-450b33273982 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Getting quotas for project af420d43367c42e4a4b0948706dd0546. Resources: {'ram', 'cores', 'instances'} {{(pid=118185) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 21:10:20.399948 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.quota [None req-f97f8375-14e7-4098-8783-450b33273982 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Getting quotas for user 2d69edafe80649d4aff602b692e294c8 and project af420d43367c42e4a4b0948706dd0546. Resources: {'ram', 'cores', 'instances'} {{(pid=118185) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 21:10:20.411142 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-f97f8375-14e7-4098-8783-450b33273982 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Going to run 1 instances... {{(pid=118185) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 21:10:20.413405 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-f97f8375-14e7-4098-8783-450b33273982 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='21b89996-9e87-489d-8891-305f6c3d905a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118185) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 21:10:20.530326 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-f97f8375-14e7-4098-8783-450b33273982 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.654570 May 31 21:10:20.530975 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 352/739] 10.222.0.55 () {62 vars in 1187 bytes} [Tue May 31 21:10:19 2022] POST /compute/v2.1/servers => generated 401 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 31 21:10:20.541620 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-3009dbe8-4b72-41ff-aad0-d31b1b2e738f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:10:20.542253 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-3009dbe8-4b72-41ff-aad0-d31b1b2e738f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:10:20.601522 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-3009dbe8-4b72-41ff-aad0-d31b1b2e738f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:10:20.608849 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-3009dbe8-4b72-41ff-aad0-d31b1b2e738f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:10:20.610931 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-3009dbe8-4b72-41ff-aad0-d31b1b2e738f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:10:20.612232 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-3009dbe8-4b72-41ff-aad0-d31b1b2e738f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1278 microversion: 2.20 time: 0.074664 May 31 21:10:20.612779 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 388/740] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:10:20 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1278 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:10:21.632014 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-9546364d-2d71-4f61-9c34-949887123b4c tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:10:21.632552 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-9546364d-2d71-4f61-9c34-949887123b4c tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:10:21.640068 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9546364d-2d71-4f61-9c34-949887123b4c tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:21.640294 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9546364d-2d71-4f61-9c34-949887123b4c tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:21.641094 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9546364d-2d71-4f61-9c34-949887123b4c tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:21.641536 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9546364d-2d71-4f61-9c34-949887123b4c tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:21.710305 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-9546364d-2d71-4f61-9c34-949887123b4c tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:10:21.718558 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-9546364d-2d71-4f61-9c34-949887123b4c tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:10:21.720115 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-9546364d-2d71-4f61-9c34-949887123b4c tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:10:21.721220 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-9546364d-2d71-4f61-9c34-949887123b4c tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1282 microversion: 2.20 time: 0.093764 May 31 21:10:21.721978 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 353/741] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:10:21 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1282 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 21:10:22.743501 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-3c7ce55f-d588-484d-8ea0-c1895656c43a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:10:22.744343 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-3c7ce55f-d588-484d-8ea0-c1895656c43a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:10:22.752596 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-3c7ce55f-d588-484d-8ea0-c1895656c43a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:22.753404 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-3c7ce55f-d588-484d-8ea0-c1895656c43a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:22.754700 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-3c7ce55f-d588-484d-8ea0-c1895656c43a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:22.755352 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-3c7ce55f-d588-484d-8ea0-c1895656c43a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:22.842340 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-3c7ce55f-d588-484d-8ea0-c1895656c43a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:10:22.852137 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-3c7ce55f-d588-484d-8ea0-c1895656c43a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:10:22.853771 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-3c7ce55f-d588-484d-8ea0-c1895656c43a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:10:22.866240 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-3c7ce55f-d588-484d-8ea0-c1895656c43a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1348 microversion: 2.20 time: 0.119520 May 31 21:10:22.866240 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 389/742] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:10:22 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1348 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:10:23.876916 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-07641ed9-ccc2-43ac-891e-a28cfd03dfb5 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:10:23.878336 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-07641ed9-ccc2-43ac-891e-a28cfd03dfb5 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:10:23.886612 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-07641ed9-ccc2-43ac-891e-a28cfd03dfb5 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:23.887344 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-07641ed9-ccc2-43ac-891e-a28cfd03dfb5 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:23.888332 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-07641ed9-ccc2-43ac-891e-a28cfd03dfb5 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:23.888952 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-07641ed9-ccc2-43ac-891e-a28cfd03dfb5 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:24.120888 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-07641ed9-ccc2-43ac-891e-a28cfd03dfb5 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:10:24.144703 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-07641ed9-ccc2-43ac-891e-a28cfd03dfb5 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:10:24.158377 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-07641ed9-ccc2-43ac-891e-a28cfd03dfb5 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:10:24.161049 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-07641ed9-ccc2-43ac-891e-a28cfd03dfb5 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1403 microversion: 2.20 time: 0.290415 May 31 21:10:24.180339 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 354/743] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:10:23 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1403 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:10:24.695391 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [req-b9a6c50c-e862-431f-81ac-39cd63ec59c3 req-fe7ceb29-abb9-4d98-af95-209e18332155 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d316a51-73db-479f-8449-ab51b42548e4", "tag": "ad3164a5-db8a-4332-a6c0-bcd7015cabda"}]} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:10:24.703720 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-b9a6c50c-e862-431f-81ac-39cd63ec59c3 req-fe7ceb29-abb9-4d98-af95-209e18332155 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:24.704966 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-b9a6c50c-e862-431f-81ac-39cd63ec59c3 req-fe7ceb29-abb9-4d98-af95-209e18332155 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:24.717814 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.compute.server_external_events [req-b9a6c50c-e862-431f-81ac-39cd63ec59c3 req-fe7ceb29-abb9-4d98-af95-209e18332155 service nova] Creating event network-changed:ad3164a5-db8a-4332-a6c0-bcd7015cabda for instance 1d316a51-73db-479f-8449-ab51b42548e4 on hv-cinder-83979 May 31 21:10:24.728001 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [req-b9a6c50c-e862-431f-81ac-39cd63ec59c3 req-fe7ceb29-abb9-4d98-af95-209e18332155 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035974 May 31 21:10:24.728755 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 390/744] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:10:25.189186 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-4576e411-af12-464b-9bfa-9ffd4d7fd172 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:10:25.190555 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-4576e411-af12-464b-9bfa-9ffd4d7fd172 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:10:25.209782 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4576e411-af12-464b-9bfa-9ffd4d7fd172 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:25.214333 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4576e411-af12-464b-9bfa-9ffd4d7fd172 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:25.215392 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4576e411-af12-464b-9bfa-9ffd4d7fd172 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:25.216635 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4576e411-af12-464b-9bfa-9ffd4d7fd172 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:25.484987 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-4576e411-af12-464b-9bfa-9ffd4d7fd172 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:10:25.490061 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:10:25.500209 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-4576e411-af12-464b-9bfa-9ffd4d7fd172 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:10:25.502001 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-4576e411-af12-464b-9bfa-9ffd4d7fd172 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:10:25.503364 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-4576e411-af12-464b-9bfa-9ffd4d7fd172 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1403 microversion: 2.20 time: 0.319961 May 31 21:10:25.503962 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 355/745] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:10:25 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1403 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:10:26.522364 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-4b6300d5-4e63-480e-ad19-4a6650fb8fe7 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:10:26.523056 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-4b6300d5-4e63-480e-ad19-4a6650fb8fe7 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:10:26.529499 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4b6300d5-4e63-480e-ad19-4a6650fb8fe7 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:26.529966 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4b6300d5-4e63-480e-ad19-4a6650fb8fe7 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:26.530734 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4b6300d5-4e63-480e-ad19-4a6650fb8fe7 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:26.531211 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4b6300d5-4e63-480e-ad19-4a6650fb8fe7 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:26.667891 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-4b6300d5-4e63-480e-ad19-4a6650fb8fe7 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:10:26.675135 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-4b6300d5-4e63-480e-ad19-4a6650fb8fe7 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:10:26.676651 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-4b6300d5-4e63-480e-ad19-4a6650fb8fe7 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:10:26.677809 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-4b6300d5-4e63-480e-ad19-4a6650fb8fe7 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1403 microversion: 2.20 time: 0.160869 May 31 21:10:26.678388 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 391/746] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:10:26 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1403 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:10:27.696147 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-8531ab8e-a4ca-41e9-bf75-c6b0f42de464 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:10:27.697580 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-8531ab8e-a4ca-41e9-bf75-c6b0f42de464 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:10:27.706672 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-8531ab8e-a4ca-41e9-bf75-c6b0f42de464 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:27.707234 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-8531ab8e-a4ca-41e9-bf75-c6b0f42de464 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:27.708286 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-8531ab8e-a4ca-41e9-bf75-c6b0f42de464 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:27.709262 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-8531ab8e-a4ca-41e9-bf75-c6b0f42de464 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:27.852119 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-8531ab8e-a4ca-41e9-bf75-c6b0f42de464 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:10:27.861139 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-8531ab8e-a4ca-41e9-bf75-c6b0f42de464 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:10:27.862711 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-8531ab8e-a4ca-41e9-bf75-c6b0f42de464 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:10:27.863826 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-8531ab8e-a4ca-41e9-bf75-c6b0f42de464 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1403 microversion: 2.20 time: 0.171836 May 31 21:10:27.864584 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 356/747] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:10:27 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1403 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 21:10:28.881924 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-46668afc-ff03-4416-9ef0-beb32fc84db9 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:10:28.882651 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-46668afc-ff03-4416-9ef0-beb32fc84db9 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:10:28.889780 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-46668afc-ff03-4416-9ef0-beb32fc84db9 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:28.890353 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-46668afc-ff03-4416-9ef0-beb32fc84db9 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:28.891144 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-46668afc-ff03-4416-9ef0-beb32fc84db9 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:28.891574 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-46668afc-ff03-4416-9ef0-beb32fc84db9 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:29.025733 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-46668afc-ff03-4416-9ef0-beb32fc84db9 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:10:29.033640 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-46668afc-ff03-4416-9ef0-beb32fc84db9 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:10:29.035945 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-46668afc-ff03-4416-9ef0-beb32fc84db9 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:10:29.037461 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-46668afc-ff03-4416-9ef0-beb32fc84db9 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1403 microversion: 2.20 time: 0.159631 May 31 21:10:29.038317 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 392/748] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:10:28 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1403 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:10:30.055720 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-49f84671-2650-4bdf-92c8-17a06a927711 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:10:30.056440 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-49f84671-2650-4bdf-92c8-17a06a927711 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:10:30.063143 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-49f84671-2650-4bdf-92c8-17a06a927711 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:30.064403 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-49f84671-2650-4bdf-92c8-17a06a927711 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:30.065180 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-49f84671-2650-4bdf-92c8-17a06a927711 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:30.065614 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-49f84671-2650-4bdf-92c8-17a06a927711 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:30.194789 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-49f84671-2650-4bdf-92c8-17a06a927711 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:10:30.202978 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-49f84671-2650-4bdf-92c8-17a06a927711 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:10:30.204579 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-49f84671-2650-4bdf-92c8-17a06a927711 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:10:30.205680 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-49f84671-2650-4bdf-92c8-17a06a927711 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1403 microversion: 2.20 time: 0.153904 May 31 21:10:30.210095 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 357/749] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:10:30 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1403 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 21:10:30.697375 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [req-ca1178d2-d892-47e0-820e-869187afcdcf req-7c67f574-11f7-4478-b2db-87f1e5c851de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d316a51-73db-479f-8449-ab51b42548e4", "name": "network-vif-plugged", "status": "completed", "tag": "ad3164a5-db8a-4332-a6c0-bcd7015cabda"}]} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:10:30.701474 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell0:SELECT=2 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:10:30.707244 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-ca1178d2-d892-47e0-820e-869187afcdcf req-7c67f574-11f7-4478-b2db-87f1e5c851de service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:30.707688 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-ca1178d2-d892-47e0-820e-869187afcdcf req-7c67f574-11f7-4478-b2db-87f1e5c851de service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:30.712044 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:10:30.718877 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.compute.server_external_events [req-ca1178d2-d892-47e0-820e-869187afcdcf req-7c67f574-11f7-4478-b2db-87f1e5c851de service nova] Creating event network-vif-plugged:ad3164a5-db8a-4332-a6c0-bcd7015cabda for instance 1d316a51-73db-479f-8449-ab51b42548e4 on hv-cinder-83979 May 31 21:10:30.724214 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [req-ca1178d2-d892-47e0-820e-869187afcdcf req-7c67f574-11f7-4478-b2db-87f1e5c851de service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030633 May 31 21:10:30.724787 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 393/750] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:10:31.224124 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-efce2b99-4984-4d37-82df-52b355002386 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:10:31.224727 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-efce2b99-4984-4d37-82df-52b355002386 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:10:31.226669 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell0:SELECT=2 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:10:31.227324 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell0:SELECT=10 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:10:31.232865 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-efce2b99-4984-4d37-82df-52b355002386 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:31.233323 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-efce2b99-4984-4d37-82df-52b355002386 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:31.234171 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-efce2b99-4984-4d37-82df-52b355002386 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:31.234616 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-efce2b99-4984-4d37-82df-52b355002386 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:31.373507 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-efce2b99-4984-4d37-82df-52b355002386 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:10:31.382189 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-efce2b99-4984-4d37-82df-52b355002386 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:10:31.383704 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-efce2b99-4984-4d37-82df-52b355002386 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:10:31.384802 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-efce2b99-4984-4d37-82df-52b355002386 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1403 microversion: 2.20 time: 0.164691 May 31 21:10:31.385351 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 358/751] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:10:31 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1403 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:10:32.403513 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-fdd489bd-c7f7-4f50-a8a3-82b61189c212 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:10:32.404209 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-fdd489bd-c7f7-4f50-a8a3-82b61189c212 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:10:32.412267 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-fdd489bd-c7f7-4f50-a8a3-82b61189c212 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:32.412720 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-fdd489bd-c7f7-4f50-a8a3-82b61189c212 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:32.413481 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-fdd489bd-c7f7-4f50-a8a3-82b61189c212 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:32.413939 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-fdd489bd-c7f7-4f50-a8a3-82b61189c212 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:32.545580 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-fdd489bd-c7f7-4f50-a8a3-82b61189c212 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:10:32.554080 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-fdd489bd-c7f7-4f50-a8a3-82b61189c212 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:10:32.556202 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-fdd489bd-c7f7-4f50-a8a3-82b61189c212 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:10:32.556747 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-fdd489bd-c7f7-4f50-a8a3-82b61189c212 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1403 microversion: 2.20 time: 0.157981 May 31 21:10:32.562802 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 394/752] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:10:32 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1403 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:10:33.579474 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-a36da5b9-433a-48b8-a9e4-9248262bc57f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:10:33.580074 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-a36da5b9-433a-48b8-a9e4-9248262bc57f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:10:33.586853 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a36da5b9-433a-48b8-a9e4-9248262bc57f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:33.587302 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a36da5b9-433a-48b8-a9e4-9248262bc57f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:33.588072 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a36da5b9-433a-48b8-a9e4-9248262bc57f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:33.588506 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a36da5b9-433a-48b8-a9e4-9248262bc57f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:33.715818 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-a36da5b9-433a-48b8-a9e4-9248262bc57f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:10:33.724336 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-a36da5b9-433a-48b8-a9e4-9248262bc57f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:10:33.725829 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-a36da5b9-433a-48b8-a9e4-9248262bc57f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:10:33.727007 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-a36da5b9-433a-48b8-a9e4-9248262bc57f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1595 microversion: 2.20 time: 0.151504 May 31 21:10:33.727553 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 359/753] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:10:33 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1595 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:10:33.744105 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-3d472458-6fb0-4499-8d4c-8886fd1124bf tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:10:33.744606 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-3d472458-6fb0-4499-8d4c-8886fd1124bf tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:10:33.751072 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-3d472458-6fb0-4499-8d4c-8886fd1124bf tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:33.751509 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-3d472458-6fb0-4499-8d4c-8886fd1124bf tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:33.752268 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-3d472458-6fb0-4499-8d4c-8886fd1124bf tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:33.752701 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-3d472458-6fb0-4499-8d4c-8886fd1124bf tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:33.900843 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-3d472458-6fb0-4499-8d4c-8886fd1124bf tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.160534 May 31 21:10:33.901467 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 395/754] 10.222.0.55 () {60 vars in 1315 bytes} [Tue May 31 21:10:33 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4/os-interface => generated 284 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 21:10:34.858171 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [req-16777df9-8b19-44d7-b455-e9bba64c4440 req-c2501a3b-ee84-4da1-9fcd-60dd263a8638 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d316a51-73db-479f-8449-ab51b42548e4", "tag": "ad3164a5-db8a-4332-a6c0-bcd7015cabda"}]} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:10:34.866629 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-16777df9-8b19-44d7-b455-e9bba64c4440 req-c2501a3b-ee84-4da1-9fcd-60dd263a8638 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:34.867653 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-16777df9-8b19-44d7-b455-e9bba64c4440 req-c2501a3b-ee84-4da1-9fcd-60dd263a8638 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:34.878678 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.compute.server_external_events [req-16777df9-8b19-44d7-b455-e9bba64c4440 req-c2501a3b-ee84-4da1-9fcd-60dd263a8638 service nova] Creating event network-changed:ad3164a5-db8a-4332-a6c0-bcd7015cabda for instance 1d316a51-73db-479f-8449-ab51b42548e4 on hv-cinder-83979 May 31 21:10:34.883972 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [req-16777df9-8b19-44d7-b455-e9bba64c4440 req-c2501a3b-ee84-4da1-9fcd-60dd263a8638 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029439 May 31 21:10:34.884557 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 360/755] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:10:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:10:48.769290 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_api:SELECT=54,nova_api:DELETE=2 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:10:48.770822 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell1:SELECT=10 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:10:48.781360 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-0cb7bcf2-acc3-488d-a145-4bee2d7cd095 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:10:48.781360 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-0cb7bcf2-acc3-488d-a145-4bee2d7cd095 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:10:48.781971 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-0cb7bcf2-acc3-488d-a145-4bee2d7cd095 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:48.782429 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-0cb7bcf2-acc3-488d-a145-4bee2d7cd095 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:48.783219 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-0cb7bcf2-acc3-488d-a145-4bee2d7cd095 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:48.783655 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-0cb7bcf2-acc3-488d-a145-4bee2d7cd095 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:48.870922 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.objects.instance [None req-0cb7bcf2-acc3-488d-a145-4bee2d7cd095 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lazy-loading 'services' on Instance uuid ff87c7f6-31a7-4836-be01-c23f9c73629f {{(pid=118184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 21:10:49.087931 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-0cb7bcf2-acc3-488d-a145-4bee2d7cd095 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "DELETE /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f/os-volume_attachments/d9275cb8-70e1-479f-ac4e-65d619bf907c" status: 202 len: 0 microversion: 2.1 time: 0.319804 May 31 21:10:49.088427 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 396/756] 10.222.0.55 () {58 vars in 1415 bytes} [Tue May 31 21:10:48 2022] DELETE /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f/os-volume_attachments/d9275cb8-70e1-479f-ac4e-65d619bf907c => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 21:10:49.094853 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:10:49.095633 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell1:SELECT=26 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:10:49.099892 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-0f7805aa-b939-4c39-967a-4d486272a84a tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:10:49.108284 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-0f7805aa-b939-4c39-967a-4d486272a84a tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:10:49.108284 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-0f7805aa-b939-4c39-967a-4d486272a84a tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:49.108284 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-0f7805aa-b939-4c39-967a-4d486272a84a tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:49.108637 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-0f7805aa-b939-4c39-967a-4d486272a84a tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:49.109073 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-0f7805aa-b939-4c39-967a-4d486272a84a tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:49.140125 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-0f7805aa-b939-4c39-967a-4d486272a84a tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046820 May 31 21:10:49.141191 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 361/757] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 31 21:10:49 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:10:50.155542 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-ded607d0-83fa-4d80-84e0-35d138ac9113 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:10:50.156523 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-ded607d0-83fa-4d80-84e0-35d138ac9113 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:10:50.164064 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ded607d0-83fa-4d80-84e0-35d138ac9113 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:50.164506 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ded607d0-83fa-4d80-84e0-35d138ac9113 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:50.165415 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ded607d0-83fa-4d80-84e0-35d138ac9113 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:50.165780 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ded607d0-83fa-4d80-84e0-35d138ac9113 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:50.199345 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-ded607d0-83fa-4d80-84e0-35d138ac9113 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048711 May 31 21:10:50.204695 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 397/758] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 31 21:10:50 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:10:50.420271 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-9587b2d0-9759-4901-b608-f0cbca7ee3bc tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:10:50.421138 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-9587b2d0-9759-4901-b608-f0cbca7ee3bc tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:10:50.429085 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9587b2d0-9759-4901-b608-f0cbca7ee3bc tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:50.438599 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9587b2d0-9759-4901-b608-f0cbca7ee3bc tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:50.438599 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9587b2d0-9759-4901-b608-f0cbca7ee3bc tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:50.438599 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9587b2d0-9759-4901-b608-f0cbca7ee3bc tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:50.460776 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-9587b2d0-9759-4901-b608-f0cbca7ee3bc tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044590 May 31 21:10:50.461361 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 362/759] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 31 21:10:50 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 31 21:10:50.526248 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-dae6d366-9df5-4a77-8a12-2625431085b2 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:10:50.526763 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-dae6d366-9df5-4a77-8a12-2625431085b2 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:10:50.533498 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-dae6d366-9df5-4a77-8a12-2625431085b2 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:50.533967 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-dae6d366-9df5-4a77-8a12-2625431085b2 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:50.534806 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-dae6d366-9df5-4a77-8a12-2625431085b2 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:50.535238 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-dae6d366-9df5-4a77-8a12-2625431085b2 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:50.561321 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-dae6d366-9df5-4a77-8a12-2625431085b2 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Going to try to terminate instance {{(pid=118184) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 21:10:50.893925 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-dae6d366-9df5-4a77-8a12-2625431085b2 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "DELETE /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 204 len: 0 microversion: 2.1 time: 0.371279 May 31 21:10:50.894727 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 398/760] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 31 21:10:50 2022] DELETE /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 31 21:10:50.903745 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-ce966114-b508-497c-8879-4056f91621c7 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:10:50.904361 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-ce966114-b508-497c-8879-4056f91621c7 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:10:50.911193 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ce966114-b508-497c-8879-4056f91621c7 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:50.914117 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ce966114-b508-497c-8879-4056f91621c7 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:50.914117 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ce966114-b508-497c-8879-4056f91621c7 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:50.914117 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ce966114-b508-497c-8879-4056f91621c7 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:51.045071 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-ce966114-b508-497c-8879-4056f91621c7 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:10:51.052591 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-ce966114-b508-497c-8879-4056f91621c7 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1673 microversion: 2.1 time: 0.153264 May 31 21:10:51.053162 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 363/761] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:10:50 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:10:51.212714 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-92c4fe2d-83da-4156-8806-9f3983fc36b8 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:10:51.213742 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-92c4fe2d-83da-4156-8806-9f3983fc36b8 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:10:51.220691 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-92c4fe2d-83da-4156-8806-9f3983fc36b8 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:51.221145 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-92c4fe2d-83da-4156-8806-9f3983fc36b8 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:51.221936 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-92c4fe2d-83da-4156-8806-9f3983fc36b8 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:51.222378 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-92c4fe2d-83da-4156-8806-9f3983fc36b8 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:51.252737 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-92c4fe2d-83da-4156-8806-9f3983fc36b8 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045293 May 31 21:10:51.253302 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 399/762] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 31 21:10:51 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 31 21:10:51.348098 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-8316aaf3-2a3d-4b73-a76d-8fb1184961a4 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:10:51.348589 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-8316aaf3-2a3d-4b73-a76d-8fb1184961a4 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:10:51.355383 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-8316aaf3-2a3d-4b73-a76d-8fb1184961a4 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:51.355833 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-8316aaf3-2a3d-4b73-a76d-8fb1184961a4 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:51.356615 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-8316aaf3-2a3d-4b73-a76d-8fb1184961a4 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:51.357043 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-8316aaf3-2a3d-4b73-a76d-8fb1184961a4 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:51.382787 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-8316aaf3-2a3d-4b73-a76d-8fb1184961a4 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Going to try to terminate instance {{(pid=118185) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 21:10:51.657806 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-8316aaf3-2a3d-4b73-a76d-8fb1184961a4 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "DELETE /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 204 len: 0 microversion: 2.1 time: 0.313281 May 31 21:10:51.658626 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 364/763] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 31 21:10:51 2022] DELETE /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 31 21:10:51.666796 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-c8351648-bf41-445a-a3d3-f65f8ecf472b tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:10:51.667399 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-c8351648-bf41-445a-a3d3-f65f8ecf472b tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:10:51.673931 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c8351648-bf41-445a-a3d3-f65f8ecf472b tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:51.674379 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c8351648-bf41-445a-a3d3-f65f8ecf472b tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:51.675173 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c8351648-bf41-445a-a3d3-f65f8ecf472b tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:51.675612 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c8351648-bf41-445a-a3d3-f65f8ecf472b tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:51.821220 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-c8351648-bf41-445a-a3d3-f65f8ecf472b tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:10:51.829198 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-c8351648-bf41-445a-a3d3-f65f8ecf472b tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1690 microversion: 2.1 time: 0.166281 May 31 21:10:51.829780 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 400/764] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:10:51 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1690 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:10:52.072868 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-77e44716-3032-46c4-b6dd-8e5fe0212299 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:10:52.073665 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-77e44716-3032-46c4-b6dd-8e5fe0212299 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:10:52.080914 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-77e44716-3032-46c4-b6dd-8e5fe0212299 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:52.081404 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-77e44716-3032-46c4-b6dd-8e5fe0212299 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:52.082223 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-77e44716-3032-46c4-b6dd-8e5fe0212299 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:52.082698 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-77e44716-3032-46c4-b6dd-8e5fe0212299 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:52.220211 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-77e44716-3032-46c4-b6dd-8e5fe0212299 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:10:52.229842 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-77e44716-3032-46c4-b6dd-8e5fe0212299 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1673 microversion: 2.1 time: 0.162332 May 31 21:10:52.230447 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 365/765] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:10:52 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1673 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:10:52.846741 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-c044e246-8c30-4eca-a16e-571c9b7ed6ec tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:10:52.847322 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-c044e246-8c30-4eca-a16e-571c9b7ed6ec tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:10:52.854497 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c044e246-8c30-4eca-a16e-571c9b7ed6ec tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:52.854944 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c044e246-8c30-4eca-a16e-571c9b7ed6ec tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:52.855706 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c044e246-8c30-4eca-a16e-571c9b7ed6ec tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:52.856135 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c044e246-8c30-4eca-a16e-571c9b7ed6ec tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:52.989742 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-c044e246-8c30-4eca-a16e-571c9b7ed6ec tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:10:52.998090 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-c044e246-8c30-4eca-a16e-571c9b7ed6ec tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1690 microversion: 2.1 time: 0.155107 May 31 21:10:52.998658 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 401/766] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:10:52 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1690 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:10:53.246900 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-ae2601f8-7399-4b87-b616-17a3d2e51b82 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:10:53.247685 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-ae2601f8-7399-4b87-b616-17a3d2e51b82 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:10:53.254285 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ae2601f8-7399-4b87-b616-17a3d2e51b82 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:53.254732 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ae2601f8-7399-4b87-b616-17a3d2e51b82 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:53.255507 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ae2601f8-7399-4b87-b616-17a3d2e51b82 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:53.255938 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ae2601f8-7399-4b87-b616-17a3d2e51b82 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:53.394979 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-ae2601f8-7399-4b87-b616-17a3d2e51b82 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:10:53.403492 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-ae2601f8-7399-4b87-b616-17a3d2e51b82 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1673 microversion: 2.1 time: 0.160519 May 31 21:10:53.404084 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 366/767] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:10:53 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1673 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:10:54.014811 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-847b13b1-03aa-48e6-9c85-7f4b9ea221f4 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:10:54.015371 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-847b13b1-03aa-48e6-9c85-7f4b9ea221f4 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:10:54.022315 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-847b13b1-03aa-48e6-9c85-7f4b9ea221f4 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:54.022762 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-847b13b1-03aa-48e6-9c85-7f4b9ea221f4 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:54.023568 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-847b13b1-03aa-48e6-9c85-7f4b9ea221f4 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:54.024022 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-847b13b1-03aa-48e6-9c85-7f4b9ea221f4 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:54.166028 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-847b13b1-03aa-48e6-9c85-7f4b9ea221f4 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:10:54.174191 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-847b13b1-03aa-48e6-9c85-7f4b9ea221f4 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1690 microversion: 2.1 time: 0.163309 May 31 21:10:54.174789 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 402/768] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:10:54 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1690 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:10:54.421697 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-822f2ad8-2ed0-4103-a355-4bb6c0331bbe tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:10:54.422283 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-822f2ad8-2ed0-4103-a355-4bb6c0331bbe tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:10:54.428877 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-822f2ad8-2ed0-4103-a355-4bb6c0331bbe tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:54.429363 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-822f2ad8-2ed0-4103-a355-4bb6c0331bbe tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:54.430214 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-822f2ad8-2ed0-4103-a355-4bb6c0331bbe tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:54.430653 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-822f2ad8-2ed0-4103-a355-4bb6c0331bbe tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:54.569669 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-822f2ad8-2ed0-4103-a355-4bb6c0331bbe tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:10:54.577809 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-822f2ad8-2ed0-4103-a355-4bb6c0331bbe tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1673 microversion: 2.1 time: 0.160034 May 31 21:10:54.578495 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 367/769] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:10:54 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1673 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:10:55.191560 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-7cec698f-768e-45e2-9f48-c6dd19c151dc tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:10:55.192252 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-7cec698f-768e-45e2-9f48-c6dd19c151dc tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:10:55.199814 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7cec698f-768e-45e2-9f48-c6dd19c151dc tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:55.200367 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7cec698f-768e-45e2-9f48-c6dd19c151dc tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:55.201153 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7cec698f-768e-45e2-9f48-c6dd19c151dc tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:55.201596 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7cec698f-768e-45e2-9f48-c6dd19c151dc tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:55.347124 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-7cec698f-768e-45e2-9f48-c6dd19c151dc tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:10:55.355191 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-7cec698f-768e-45e2-9f48-c6dd19c151dc tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1690 microversion: 2.1 time: 0.167664 May 31 21:10:55.355930 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 403/770] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:10:55 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1690 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:10:55.595555 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-fc3ce4ab-a35f-4ddf-a375-4f2f1ff0147e tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:10:55.596368 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-fc3ce4ab-a35f-4ddf-a375-4f2f1ff0147e tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:10:55.603776 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-fc3ce4ab-a35f-4ddf-a375-4f2f1ff0147e tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:55.606618 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-fc3ce4ab-a35f-4ddf-a375-4f2f1ff0147e tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:55.606618 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-fc3ce4ab-a35f-4ddf-a375-4f2f1ff0147e tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:55.606618 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-fc3ce4ab-a35f-4ddf-a375-4f2f1ff0147e tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:55.743710 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-fc3ce4ab-a35f-4ddf-a375-4f2f1ff0147e tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:10:55.751537 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-fc3ce4ab-a35f-4ddf-a375-4f2f1ff0147e tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1673 microversion: 2.1 time: 0.160150 May 31 21:10:55.752102 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 368/771] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:10:55 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:10:56.375277 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-385a7393-c824-4d8b-8914-9325fc29fda4 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:10:56.376164 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-385a7393-c824-4d8b-8914-9325fc29fda4 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:10:56.383951 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-385a7393-c824-4d8b-8914-9325fc29fda4 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:56.384409 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-385a7393-c824-4d8b-8914-9325fc29fda4 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:56.385220 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-385a7393-c824-4d8b-8914-9325fc29fda4 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:56.385700 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-385a7393-c824-4d8b-8914-9325fc29fda4 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:56.441283 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [req-912cf471-a994-446f-8512-4ff9fc6f1368 req-0cedb488-a196-40ea-981c-87574f39aa6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faf12fce-2352-40df-a297-0d7b28379014", "name": "network-vif-deleted", "tag": "eb53f5b6-46bd-4009-8d09-18c62dd763ce"}]} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:10:56.457741 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-912cf471-a994-446f-8512-4ff9fc6f1368 req-0cedb488-a196-40ea-981c-87574f39aa6f service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:56.462501 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-912cf471-a994-446f-8512-4ff9fc6f1368 req-0cedb488-a196-40ea-981c-87574f39aa6f service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:56.495978 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.compute.server_external_events [req-912cf471-a994-446f-8512-4ff9fc6f1368 req-0cedb488-a196-40ea-981c-87574f39aa6f service nova] Creating event network-vif-deleted:eb53f5b6-46bd-4009-8d09-18c62dd763ce for instance faf12fce-2352-40df-a297-0d7b28379014 on hv-cinder-83979 May 31 21:10:56.506682 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [req-912cf471-a994-446f-8512-4ff9fc6f1368 req-0cedb488-a196-40ea-981c-87574f39aa6f service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069064 May 31 21:10:56.509108 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 369/772] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 21:10:56.509832 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-385a7393-c824-4d8b-8914-9325fc29fda4 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:10:56.520462 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-385a7393-c824-4d8b-8914-9325fc29fda4 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1622 microversion: 2.1 time: 0.150371 May 31 21:10:56.522702 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 404/773] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:10:56 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1622 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:10:56.776789 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-aa2622a8-d2e7-44f6-a738-88d5fde3e747 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:10:56.778240 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-aa2622a8-d2e7-44f6-a738-88d5fde3e747 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:10:56.790304 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-aa2622a8-d2e7-44f6-a738-88d5fde3e747 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:56.791001 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-aa2622a8-d2e7-44f6-a738-88d5fde3e747 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:56.791828 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-aa2622a8-d2e7-44f6-a738-88d5fde3e747 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:56.792427 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-aa2622a8-d2e7-44f6-a738-88d5fde3e747 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:56.857819 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-aa2622a8-d2e7-44f6-a738-88d5fde3e747 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:56.858560 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-aa2622a8-d2e7-44f6-a738-88d5fde3e747 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:56.859034 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.objects.instance [None req-aa2622a8-d2e7-44f6-a738-88d5fde3e747 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lazy-loading 'fault' on Instance uuid faf12fce-2352-40df-a297-0d7b28379014 {{(pid=118185) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 21:10:56.908603 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-aa2622a8-d2e7-44f6-a738-88d5fde3e747 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:10:56.917731 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-aa2622a8-d2e7-44f6-a738-88d5fde3e747 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 200 len: 1327 microversion: 2.1 time: 0.151716 May 31 21:10:56.925961 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 370/774] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:10:56 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 1327 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:10:57.546257 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-87de5054-26f1-498f-8286-3008a350edaf tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:10:57.547075 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-87de5054-26f1-498f-8286-3008a350edaf tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:10:57.553733 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-87de5054-26f1-498f-8286-3008a350edaf tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:57.558717 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-87de5054-26f1-498f-8286-3008a350edaf tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:57.559712 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-87de5054-26f1-498f-8286-3008a350edaf tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:57.560133 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-87de5054-26f1-498f-8286-3008a350edaf tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:57.594218 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-87de5054-26f1-498f-8286-3008a350edaf tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:57.594678 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-87de5054-26f1-498f-8286-3008a350edaf tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:57.595139 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.objects.instance [None req-87de5054-26f1-498f-8286-3008a350edaf tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lazy-loading 'fault' on Instance uuid ff87c7f6-31a7-4836-be01-c23f9c73629f {{(pid=118184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 21:10:57.642803 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-87de5054-26f1-498f-8286-3008a350edaf tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:10:57.651625 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-87de5054-26f1-498f-8286-3008a350edaf tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 200 len: 1334 microversion: 2.1 time: 0.109384 May 31 21:10:57.652227 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 405/775] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:10:57 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 1334 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:10:57.936090 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-dded921a-2aa4-4b0b-ab03-b3be3e39cac9 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:10:57.936736 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-dded921a-2aa4-4b0b-ab03-b3be3e39cac9 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:10:57.942891 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-dded921a-2aa4-4b0b-ab03-b3be3e39cac9 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:57.943343 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-dded921a-2aa4-4b0b-ab03-b3be3e39cac9 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:57.944120 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-dded921a-2aa4-4b0b-ab03-b3be3e39cac9 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:57.944562 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-dded921a-2aa4-4b0b-ab03-b3be3e39cac9 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:57.962831 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.wsgi [None req-dded921a-2aa4-4b0b-ab03-b3be3e39cac9 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] HTTP exception thrown: Instance faf12fce-2352-40df-a297-0d7b28379014 could not be found. May 31 21:10:57.964552 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-dded921a-2aa4-4b0b-ab03-b3be3e39cac9 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Request method failure captured: May 31 21:10:57.964552 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: request: GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 HTTP/1.1 May 31 21:10:57.964552 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Accept: application/json May 31 21:10:57.964552 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Accept-Encoding: identity May 31 21:10:57.964552 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Connection: close May 31 21:10:57.964552 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Content-Length: 0 May 31 21:10:57.964552 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Content-Type: application/json May 31 21:10:57.964552 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Host: 10.222.0.55 May 31 21:10:57.964552 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Openstack-System-Scope: None May 31 21:10:57.964552 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: User-Agent: python-urllib3/1.26.9 May 31 21:10:57.964552 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Auth-Token: gAAAAABiloKlkZoew85L1TdCmvO0RFP1xR5mXT6X2xEUB88pFhrUEE8uhof8Swf6MYZG3U_Q9b3Ivpfr-tfaWezatCne581AbmNbIqsdiz5siTPedALRZj6Qi0G6LR9gf9wTw3iAO_L_Nittc_1-f3oOlHbRyr-NnMcGkWfji8-9-Ep-WPTa_vI May 31 21:10:57.964552 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Domain-Id: None May 31 21:10:57.964552 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Domain-Name: None May 31 21:10:57.964552 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Identity-Status: Confirmed May 31 21:10:57.964552 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Is-Admin-Project: True May 31 21:10:57.964552 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Domain-Id: default May 31 21:10:57.964552 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Domain-Name: Default May 31 21:10:57.964552 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Id: 180ff6fd8c5b434abffa058ea99ef7c4 May 31 21:10:57.964552 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Name: tempest-AttachVolumeTestJSON-47090901 May 31 21:10:57.964552 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Role: member,reader May 31 21:10:57.964552 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Roles: member,reader May 31 21:10:57.967181 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/180ff6fd8c5b434abffa058ea99ef7c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/180ff6fd8c5b434abffa058ea99ef7c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_180ff6fd8c5b434abffa058ea99ef7c4", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/180ff6fd8c5b434abffa058ea99ef7c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] May 31 21:10:57.967181 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant: tempest-AttachVolumeTestJSON-47090901 May 31 21:10:57.967181 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant-Id: 180ff6fd8c5b434abffa058ea99ef7c4 May 31 21:10:57.967181 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant-Name: tempest-AttachVolumeTestJSON-47090901 May 31 21:10:57.967181 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User: tempest-AttachVolumeTestJSON-47090901-project May 31 21:10:57.967181 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Domain-Id: default May 31 21:10:57.967181 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Domain-Name: Default May 31 21:10:57.967181 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Id: 92d56ad8d4ab4c1099263a3d1c43490a May 31 21:10:57.967181 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Name: tempest-AttachVolumeTestJSON-47090901-project May 31 21:10:57.967181 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: method: > May 31 21:10:57.967181 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: exception: Instance faf12fce-2352-40df-a297-0d7b28379014 could not be found. May 31 21:10:57.967181 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: action_args: {'id': 'faf12fce-2352-40df-a297-0d7b28379014'} May 31 21:10:57.968068 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 21:10:57.968068 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:10:57.968068 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 21:10:57.968068 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 21:10:57.968068 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 21:10:57.968068 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 21:10:57.968068 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 21:10:57.968068 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 21:10:57.968068 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 21:10:57.968068 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 21:10:57.968068 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance faf12fce-2352-40df-a297-0d7b28379014 could not be found. May 31 21:10:57.968068 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:10:57.968068 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:10:57.968068 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:10:57.968068 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:10:57.968068 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:10:57.968068 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:10:57.968068 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 21:10:57.968068 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 21:10:57.968068 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 21:10:57.969560 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 21:10:57.969560 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 21:10:57.969560 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 21:10:57.969560 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 21:10:57.969560 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 21:10:57.969560 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 21:10:57.969560 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 21:10:57.969560 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance faf12fce-2352-40df-a297-0d7b28379014 could not be found. May 31 21:10:57.969560 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:10:57.969560 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:10:57.969560 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:10:57.969560 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:10:57.969560 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:10:57.969560 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:10:57.969560 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 21:10:57.969560 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 21:10:57.969560 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance faf12fce-2352-40df-a297-0d7b28379014 could not be found. May 31 21:10:57.969560 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:10:57.970920 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-dded921a-2aa4-4b0b-ab03-b3be3e39cac9 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Returning 404 to user: Instance faf12fce-2352-40df-a297-0d7b28379014 could not be found. {{(pid=118185) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 21:10:57.970920 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-dded921a-2aa4-4b0b-ab03-b3be3e39cac9 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 404 len: 111 microversion: 2.1 time: 0.034961 May 31 21:10:57.970920 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 371/776] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:10:57 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 21:10:57.982750 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-ca8118e2-b273-4752-b963-de2dcf1c6106 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '.version_select at 0x7fe7c0b7b820>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:10:58.092639 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-ca8118e2-b273-4752-b963-de2dcf1c6106 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-869555078" status: 202 len: 0 microversion: 2.1 time: 0.118678 May 31 21:10:58.093391 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 406/777] 10.222.0.55 () {58 vars in 1217 bytes} [Tue May 31 21:10:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-869555078 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 21:10:58.525161 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [req-1f205f7d-ee65-41a5-9ceb-d9b1ce3ae51c req-927a19be-c843-4ded-aa96-9eb58ec91c0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff87c7f6-31a7-4836-be01-c23f9c73629f", "name": "network-vif-deleted", "tag": "f7d9ea30-c776-41ba-8cc7-b1d9dce9aa77"}]} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:10:58.533799 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-1f205f7d-ee65-41a5-9ceb-d9b1ce3ae51c req-927a19be-c843-4ded-aa96-9eb58ec91c0d service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:58.534266 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-1f205f7d-ee65-41a5-9ceb-d9b1ce3ae51c req-927a19be-c843-4ded-aa96-9eb58ec91c0d service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:58.545947 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.compute.server_external_events [req-1f205f7d-ee65-41a5-9ceb-d9b1ce3ae51c req-927a19be-c843-4ded-aa96-9eb58ec91c0d service nova] Creating event network-vif-deleted:f7d9ea30-c776-41ba-8cc7-b1d9dce9aa77 for instance ff87c7f6-31a7-4836-be01-c23f9c73629f on hv-cinder-83979 May 31 21:10:58.552039 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [req-1f205f7d-ee65-41a5-9ceb-d9b1ce3ae51c req-927a19be-c843-4ded-aa96-9eb58ec91c0d service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030617 May 31 21:10:58.552872 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 372/778] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:10:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:10:58.670578 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-3cd2f746-c9d3-479f-a231-746ba09b780c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:10:58.671184 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-3cd2f746-c9d3-479f-a231-746ba09b780c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: ff87c7f6-31a7-4836-be01-c23f9c73629f] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:10:58.678686 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-3cd2f746-c9d3-479f-a231-746ba09b780c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:58.683025 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-3cd2f746-c9d3-479f-a231-746ba09b780c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:58.684790 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-3cd2f746-c9d3-479f-a231-746ba09b780c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:10:58.685677 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-3cd2f746-c9d3-479f-a231-746ba09b780c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:10:58.707963 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.wsgi [None req-3cd2f746-c9d3-479f-a231-746ba09b780c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] HTTP exception thrown: Instance ff87c7f6-31a7-4836-be01-c23f9c73629f could not be found. May 31 21:10:58.710126 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-3cd2f746-c9d3-479f-a231-746ba09b780c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Request method failure captured: May 31 21:10:58.710126 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: request: GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f HTTP/1.1 May 31 21:10:58.710126 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Accept: application/json May 31 21:10:58.710126 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Accept-Encoding: identity May 31 21:10:58.710126 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Connection: close May 31 21:10:58.710126 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Content-Length: 0 May 31 21:10:58.710126 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Content-Type: application/json May 31 21:10:58.710126 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Host: 10.222.0.55 May 31 21:10:58.710126 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Openstack-System-Scope: None May 31 21:10:58.710126 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: User-Agent: python-urllib3/1.26.9 May 31 21:10:58.710126 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Auth-Token: gAAAAABiloKngpou4fcrhJSECdfOHFsnMzu14lCOGutNAWHrekz0pgYMq4g1wmFaJxYB11cNdAFG04NttpTVQ0IQX971BK1KwyKsW5u5cbGZqnRRimaXJ-Df08ghf2T6DQWELhQSwIrMDVTC_eNXuZkmjTncSbGwdASXfJc-kC3SbyJrBM1jos4 May 31 21:10:58.710126 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Domain-Id: None May 31 21:10:58.710126 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Domain-Name: None May 31 21:10:58.710126 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Identity-Status: Confirmed May 31 21:10:58.710126 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Is-Admin-Project: True May 31 21:10:58.710126 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Domain-Id: default May 31 21:10:58.710126 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Domain-Name: Default May 31 21:10:58.710126 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Id: f1b54ceb69fc4041b743a11eda4144a8 May 31 21:10:58.710126 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1103944919 May 31 21:10:58.710126 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Role: member,reader May 31 21:10:58.710126 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Roles: member,reader May 31 21:10:58.713002 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/f1b54ceb69fc4041b743a11eda4144a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f1b54ceb69fc4041b743a11eda4144a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_f1b54ceb69fc4041b743a11eda4144a8", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f1b54ceb69fc4041b743a11eda4144a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] May 31 21:10:58.713002 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1103944919 May 31 21:10:58.713002 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant-Id: f1b54ceb69fc4041b743a11eda4144a8 May 31 21:10:58.713002 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1103944919 May 31 21:10:58.713002 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User: tempest-ServerRescueNegativeTestJSON-1103944919-project May 31 21:10:58.713002 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Domain-Id: default May 31 21:10:58.713002 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Domain-Name: Default May 31 21:10:58.713002 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Id: bbf377756836405d804d2aaba6e44c1f May 31 21:10:58.713002 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1103944919-project May 31 21:10:58.713002 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: method: > May 31 21:10:58.713002 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: exception: Instance ff87c7f6-31a7-4836-be01-c23f9c73629f could not be found. May 31 21:10:58.713002 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: action_args: {'id': 'ff87c7f6-31a7-4836-be01-c23f9c73629f'} May 31 21:10:58.714487 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 21:10:58.714487 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:10:58.714487 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 21:10:58.714487 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 21:10:58.714487 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 21:10:58.714487 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 21:10:58.714487 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 21:10:58.714487 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 21:10:58.714487 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 21:10:58.714487 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 21:10:58.714487 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff87c7f6-31a7-4836-be01-c23f9c73629f could not be found. May 31 21:10:58.714487 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:10:58.714487 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:10:58.714487 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:10:58.714487 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:10:58.714487 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:10:58.714487 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:10:58.714487 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 21:10:58.714487 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 21:10:58.714487 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 21:10:58.715637 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 21:10:58.715637 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 21:10:58.715637 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 21:10:58.715637 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 21:10:58.715637 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 21:10:58.715637 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 21:10:58.715637 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 21:10:58.715637 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff87c7f6-31a7-4836-be01-c23f9c73629f could not be found. May 31 21:10:58.715637 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:10:58.715637 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:10:58.715637 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:10:58.715637 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:10:58.715637 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:10:58.715637 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:10:58.715637 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 21:10:58.715637 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 21:10:58.715637 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff87c7f6-31a7-4836-be01-c23f9c73629f could not be found. May 31 21:10:58.715637 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:10:58.716917 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-3cd2f746-c9d3-479f-a231-746ba09b780c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Returning 404 to user: Instance ff87c7f6-31a7-4836-be01-c23f9c73629f could not be found. {{(pid=118184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 21:10:58.716917 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-3cd2f746-c9d3-479f-a231-746ba09b780c tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f" status: 404 len: 111 microversion: 2.1 time: 0.045586 May 31 21:10:58.716917 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 407/779] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:10:58 2022] GET /compute/v2.1/servers/ff87c7f6-31a7-4836-be01-c23f9c73629f => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 21:10:58.722134 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-7e9f8014-f33c-49a5-b9ea-26902f30df9a tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '.version_select at 0x7fe7c5f96670>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:10:58.838003 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-7e9f8014-f33c-49a5-b9ea-26902f30df9a tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-114727409" status: 202 len: 0 microversion: 2.1 time: 0.120176 May 31 21:10:58.838594 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 373/780] 10.222.0.55 () {58 vars in 1217 bytes} [Tue May 31 21:10:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-114727409 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 21:10:59.012100 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-08e7766e-6305-43ef-a5d0-fa87a6f91ab4 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Action: 'create', calling method: .version_select at 0x7fe7c0cd5280>, body: {"keypair": {"name": "tempest-keypair-1672577644", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCk0DN2XHUb6+n01B9qljTsqu1nq8baqn/kjRVGOKA9nkZVut5OkzZ1zl5uIadv39jVE/UhNA6flgnlUytBcDarHsOcPUzJexcOYQRqsTFQTKue+Sm7+y7ji962baliWeQ=="}} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:10:59.029308 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.quota [None req-08e7766e-6305-43ef-a5d0-fa87a6f91ab4 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Getting quotas for project 180ff6fd8c5b434abffa058ea99ef7c4. Resources: {'key_pairs'} {{(pid=118184) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 21:10:59.038478 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.quota [None req-08e7766e-6305-43ef-a5d0-fa87a6f91ab4 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Getting quotas for user 92d56ad8d4ab4c1099263a3d1c43490a and project 180ff6fd8c5b434abffa058ea99ef7c4. Resources: {'key_pairs'} {{(pid=118184) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 21:10:59.154895 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-08e7766e-6305-43ef-a5d0-fa87a6f91ab4 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.147426 May 31 21:10:59.155944 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 408/781] 10.222.0.55 () {60 vars in 1158 bytes} [Tue May 31 21:10:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:11:01.523082 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-e12eec4b-dd9c-4e1b-90c5-6f75d7945778 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-964045617", "imageRef": "21b89996-9e87-489d-8891-305f6c3d905a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1cab6d20-22a6-4088-8e1d-60992c365df4"}], "security_groups": [{"name": "tempest-securitygroup--985717226"}], "key_name": "tempest-keypair-1672577644", "user_data": "}} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:11:01.631307 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.network.neutron [None req-e12eec4b-dd9c-4e1b-90c5-6f75d7945778 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] validate_networks() for [('1cab6d20-22a6-4088-8e1d-60992c365df4', None, None, None, None, None)] {{(pid=118185) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 21:11:02.254830 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.virt.hardware [None req-e12eec4b-dd9c-4e1b-90c5-6f75d7945778 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Flavor limits 0:0:0 {{(pid=118185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 21:11:02.255250 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.virt.hardware [None req-e12eec4b-dd9c-4e1b-90c5-6f75d7945778 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Image limits 0:0:0 {{(pid=118185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 21:11:02.255718 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.virt.hardware [None req-e12eec4b-dd9c-4e1b-90c5-6f75d7945778 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Flavor pref 0:0:0 {{(pid=118185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 21:11:02.256124 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.virt.hardware [None req-e12eec4b-dd9c-4e1b-90c5-6f75d7945778 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Image pref 0:0:0 {{(pid=118185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 21:11:02.256559 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.virt.hardware [None req-e12eec4b-dd9c-4e1b-90c5-6f75d7945778 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 21:11:02.266122 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e12eec4b-dd9c-4e1b-90c5-6f75d7945778 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:02.268553 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e12eec4b-dd9c-4e1b-90c5-6f75d7945778 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:02.268553 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e12eec4b-dd9c-4e1b-90c5-6f75d7945778 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:02.268553 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e12eec4b-dd9c-4e1b-90c5-6f75d7945778 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:02.285525 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.quota [None req-e12eec4b-dd9c-4e1b-90c5-6f75d7945778 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Getting quotas for project 180ff6fd8c5b434abffa058ea99ef7c4. Resources: {'ram', 'cores', 'instances'} {{(pid=118185) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 21:11:02.290763 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.quota [None req-e12eec4b-dd9c-4e1b-90c5-6f75d7945778 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Getting quotas for user 92d56ad8d4ab4c1099263a3d1c43490a and project 180ff6fd8c5b434abffa058ea99ef7c4. Resources: {'ram', 'cores', 'instances'} {{(pid=118185) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 21:11:02.302588 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-e12eec4b-dd9c-4e1b-90c5-6f75d7945778 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Going to run 1 instances... {{(pid=118185) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 21:11:02.305537 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-e12eec4b-dd9c-4e1b-90c5-6f75d7945778 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: e26c2265-9a33-4c2a-9e41-6bf685f4c525] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='21b89996-9e87-489d-8891-305f6c3d905a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118185) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 21:11:02.314102 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-f69366b7-ec90-44db-9990-e94ab9739c8f tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:11:02.314976 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-f69366b7-ec90-44db-9990-e94ab9739c8f tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 9bff085f-5477-4588-9e08-533189d2db08] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:11:02.321531 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f69366b7-ec90-44db-9990-e94ab9739c8f tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:02.322109 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f69366b7-ec90-44db-9990-e94ab9739c8f tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:02.322984 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f69366b7-ec90-44db-9990-e94ab9739c8f tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:02.323576 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f69366b7-ec90-44db-9990-e94ab9739c8f tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:02.350790 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-f69366b7-ec90-44db-9990-e94ab9739c8f tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 9bff085f-5477-4588-9e08-533189d2db08] Going to try to terminate instance {{(pid=118184) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 21:11:02.428822 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-e12eec4b-dd9c-4e1b-90c5-6f75d7945778 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.910591 May 31 21:11:02.429546 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 374/782] 10.222.0.55 () {60 vars in 1146 bytes} [Tue May 31 21:11:01 2022] POST /compute/v2.1/servers => generated 401 bytes in 912 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 31 21:11:02.439886 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-57d4b7c3-5947-4e1c-b0f0-58301e4b25dd tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:11:02.440505 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-57d4b7c3-5947-4e1c-b0f0-58301e4b25dd tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: e26c2265-9a33-4c2a-9e41-6bf685f4c525] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:11:02.495140 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-57d4b7c3-5947-4e1c-b0f0-58301e4b25dd tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:02.503876 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-57d4b7c3-5947-4e1c-b0f0-58301e4b25dd tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525" status: 200 len: 1237 microversion: 2.1 time: 0.065798 May 31 21:11:02.503876 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 375/783] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:11:02 2022] GET /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525 => generated 1237 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:11:02.733006 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-f69366b7-ec90-44db-9990-e94ab9739c8f tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "DELETE /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08" status: 204 len: 0 microversion: 2.1 time: 0.423236 May 31 21:11:02.733618 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 409/784] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 31 21:11:02 2022] DELETE /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 31 21:11:02.741991 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-43c69058-f9d9-4a71-96f0-d1e7bc16063d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:11:02.742609 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-43c69058-f9d9-4a71-96f0-d1e7bc16063d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 9bff085f-5477-4588-9e08-533189d2db08] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:11:02.749535 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-43c69058-f9d9-4a71-96f0-d1e7bc16063d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:02.750025 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-43c69058-f9d9-4a71-96f0-d1e7bc16063d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:02.750809 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-43c69058-f9d9-4a71-96f0-d1e7bc16063d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:02.751255 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-43c69058-f9d9-4a71-96f0-d1e7bc16063d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:02.888841 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-43c69058-f9d9-4a71-96f0-d1e7bc16063d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:02.896565 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-43c69058-f9d9-4a71-96f0-d1e7bc16063d tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08" status: 200 len: 1508 microversion: 2.1 time: 0.158529 May 31 21:11:02.901684 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 376/785] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:11:02 2022] GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08 => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:11:03.519448 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-038574ea-2562-411a-ac30-b4476c5dd66d tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:11:03.520208 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-038574ea-2562-411a-ac30-b4476c5dd66d tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: e26c2265-9a33-4c2a-9e41-6bf685f4c525] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:11:03.527013 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-038574ea-2562-411a-ac30-b4476c5dd66d tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:03.527541 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-038574ea-2562-411a-ac30-b4476c5dd66d tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:03.528396 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-038574ea-2562-411a-ac30-b4476c5dd66d tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:03.528895 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-038574ea-2562-411a-ac30-b4476c5dd66d tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:03.596314 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-038574ea-2562-411a-ac30-b4476c5dd66d tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:03.600150 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:11:03.604459 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-038574ea-2562-411a-ac30-b4476c5dd66d tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525" status: 200 len: 1241 microversion: 2.1 time: 0.089462 May 31 21:11:03.605077 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 410/786] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:11:03 2022] GET /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525 => generated 1241 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:11:03.915676 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-6dbd8aa7-8ca2-472d-bf59-5186fce478d5 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:11:03.916982 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-6dbd8aa7-8ca2-472d-bf59-5186fce478d5 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 9bff085f-5477-4588-9e08-533189d2db08] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:11:03.924660 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-6dbd8aa7-8ca2-472d-bf59-5186fce478d5 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:03.925384 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-6dbd8aa7-8ca2-472d-bf59-5186fce478d5 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:03.926596 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-6dbd8aa7-8ca2-472d-bf59-5186fce478d5 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:03.927035 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-6dbd8aa7-8ca2-472d-bf59-5186fce478d5 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:04.000130 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [req-e5625cea-48a4-4739-b19e-f47c37570588 req-5484e6c2-eb3b-445b-9b30-e9d7a2499e87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bff085f-5477-4588-9e08-533189d2db08", "name": "network-vif-deleted", "tag": "31db06ed-717e-4c7e-8538-117ccbffa87d"}]} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:11:04.002372 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-6dbd8aa7-8ca2-472d-bf59-5186fce478d5 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:04.009614 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-e5625cea-48a4-4739-b19e-f47c37570588 req-5484e6c2-eb3b-445b-9b30-e9d7a2499e87 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:04.010068 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-e5625cea-48a4-4739-b19e-f47c37570588 req-5484e6c2-eb3b-445b-9b30-e9d7a2499e87 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:04.011553 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-6dbd8aa7-8ca2-472d-bf59-5186fce478d5 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08" status: 200 len: 1466 microversion: 2.1 time: 0.100111 May 31 21:11:04.020805 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 377/787] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:11:03 2022] GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08 => generated 1466 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:11:04.022221 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.compute.server_external_events [req-e5625cea-48a4-4739-b19e-f47c37570588 req-5484e6c2-eb3b-445b-9b30-e9d7a2499e87 service nova] Creating event network-vif-deleted:31db06ed-717e-4c7e-8538-117ccbffa87d for instance 9bff085f-5477-4588-9e08-533189d2db08 on hv-cinder-83979 May 31 21:11:04.027716 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [req-e5625cea-48a4-4739-b19e-f47c37570588 req-5484e6c2-eb3b-445b-9b30-e9d7a2499e87 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032156 May 31 21:11:04.028312 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 411/788] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 21:11:04.621975 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-9baed327-7a82-4315-9464-ee9b478705aa tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:11:04.622594 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-9baed327-7a82-4315-9464-ee9b478705aa tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: e26c2265-9a33-4c2a-9e41-6bf685f4c525] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:11:04.628730 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9baed327-7a82-4315-9464-ee9b478705aa tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:04.632791 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9baed327-7a82-4315-9464-ee9b478705aa tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:04.632791 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9baed327-7a82-4315-9464-ee9b478705aa tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:04.632791 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9baed327-7a82-4315-9464-ee9b478705aa tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:04.693258 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-9baed327-7a82-4315-9464-ee9b478705aa tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:04.700877 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-9baed327-7a82-4315-9464-ee9b478705aa tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525" status: 200 len: 1297 microversion: 2.1 time: 0.083504 May 31 21:11:04.701440 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 378/789] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:11:04 2022] GET /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525 => generated 1297 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:11:05.029461 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-7a7a9984-d878-43a8-b21b-c55750e21eea tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:11:05.030246 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-7a7a9984-d878-43a8-b21b-c55750e21eea tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 9bff085f-5477-4588-9e08-533189d2db08] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:11:05.037381 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7a7a9984-d878-43a8-b21b-c55750e21eea tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:05.038104 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7a7a9984-d878-43a8-b21b-c55750e21eea tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:05.039047 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7a7a9984-d878-43a8-b21b-c55750e21eea tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:05.039483 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7a7a9984-d878-43a8-b21b-c55750e21eea tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:05.074352 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7a7a9984-d878-43a8-b21b-c55750e21eea tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:05.074810 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7a7a9984-d878-43a8-b21b-c55750e21eea tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:05.075299 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.objects.instance [None req-7a7a9984-d878-43a8-b21b-c55750e21eea tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lazy-loading 'fault' on Instance uuid 9bff085f-5477-4588-9e08-533189d2db08 {{(pid=118184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 21:11:05.115453 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-7a7a9984-d878-43a8-b21b-c55750e21eea tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:05.123362 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-7a7a9984-d878-43a8-b21b-c55750e21eea tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08" status: 200 len: 1311 microversion: 2.1 time: 0.098601 May 31 21:11:05.123921 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 412/790] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:11:05 2022] GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08 => generated 1311 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:11:05.721357 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-8f8912da-98b3-47c0-a2f4-19b186f2ded3 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:11:05.721357 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-8f8912da-98b3-47c0-a2f4-19b186f2ded3 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: e26c2265-9a33-4c2a-9e41-6bf685f4c525] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:11:05.728052 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-8f8912da-98b3-47c0-a2f4-19b186f2ded3 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:05.728516 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-8f8912da-98b3-47c0-a2f4-19b186f2ded3 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:05.729296 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-8f8912da-98b3-47c0-a2f4-19b186f2ded3 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:05.729734 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-8f8912da-98b3-47c0-a2f4-19b186f2ded3 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:05.864125 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-8f8912da-98b3-47c0-a2f4-19b186f2ded3 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:05.871746 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-8f8912da-98b3-47c0-a2f4-19b186f2ded3 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525" status: 200 len: 1362 microversion: 2.1 time: 0.157354 May 31 21:11:05.872321 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 379/791] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:11:05 2022] GET /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:11:06.141101 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-91d8d8af-68a6-43d5-bc38-435ea092b973 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:11:06.141768 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-91d8d8af-68a6-43d5-bc38-435ea092b973 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 9bff085f-5477-4588-9e08-533189d2db08] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:11:06.150084 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-91d8d8af-68a6-43d5-bc38-435ea092b973 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:06.154936 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-91d8d8af-68a6-43d5-bc38-435ea092b973 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:06.154936 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-91d8d8af-68a6-43d5-bc38-435ea092b973 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:06.154936 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-91d8d8af-68a6-43d5-bc38-435ea092b973 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:06.167512 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.wsgi [None req-91d8d8af-68a6-43d5-bc38-435ea092b973 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] HTTP exception thrown: Instance 9bff085f-5477-4588-9e08-533189d2db08 could not be found. May 31 21:11:06.169202 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-91d8d8af-68a6-43d5-bc38-435ea092b973 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Request method failure captured: May 31 21:11:06.169202 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: request: GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08 HTTP/1.1 May 31 21:11:06.169202 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Accept: application/json May 31 21:11:06.169202 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Accept-Encoding: identity May 31 21:11:06.169202 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Connection: close May 31 21:11:06.169202 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Content-Length: 0 May 31 21:11:06.169202 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Content-Type: application/json May 31 21:11:06.169202 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Host: 10.222.0.55 May 31 21:11:06.169202 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Openstack-System-Scope: None May 31 21:11:06.169202 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: User-Agent: python-urllib3/1.26.9 May 31 21:11:06.169202 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Auth-Token: gAAAAABiloKngpou4fcrhJSECdfOHFsnMzu14lCOGutNAWHrekz0pgYMq4g1wmFaJxYB11cNdAFG04NttpTVQ0IQX971BK1KwyKsW5u5cbGZqnRRimaXJ-Df08ghf2T6DQWELhQSwIrMDVTC_eNXuZkmjTncSbGwdASXfJc-kC3SbyJrBM1jos4 May 31 21:11:06.169202 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Domain-Id: None May 31 21:11:06.169202 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Domain-Name: None May 31 21:11:06.169202 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Identity-Status: Confirmed May 31 21:11:06.169202 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Is-Admin-Project: True May 31 21:11:06.169202 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Domain-Id: default May 31 21:11:06.169202 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Domain-Name: Default May 31 21:11:06.169202 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Id: f1b54ceb69fc4041b743a11eda4144a8 May 31 21:11:06.169202 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1103944919 May 31 21:11:06.169202 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Role: member,reader May 31 21:11:06.169202 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Roles: member,reader May 31 21:11:06.170712 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/f1b54ceb69fc4041b743a11eda4144a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f1b54ceb69fc4041b743a11eda4144a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_f1b54ceb69fc4041b743a11eda4144a8", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f1b54ceb69fc4041b743a11eda4144a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] May 31 21:11:06.170712 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1103944919 May 31 21:11:06.170712 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant-Id: f1b54ceb69fc4041b743a11eda4144a8 May 31 21:11:06.170712 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1103944919 May 31 21:11:06.170712 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User: tempest-ServerRescueNegativeTestJSON-1103944919-project May 31 21:11:06.170712 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Domain-Id: default May 31 21:11:06.170712 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Domain-Name: Default May 31 21:11:06.170712 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Id: bbf377756836405d804d2aaba6e44c1f May 31 21:11:06.170712 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1103944919-project May 31 21:11:06.170712 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: method: > May 31 21:11:06.170712 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: exception: Instance 9bff085f-5477-4588-9e08-533189d2db08 could not be found. May 31 21:11:06.170712 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: action_args: {'id': '9bff085f-5477-4588-9e08-533189d2db08'} May 31 21:11:06.171434 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 21:11:06.171434 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:11:06.171434 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 21:11:06.171434 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 21:11:06.171434 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 21:11:06.171434 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 21:11:06.171434 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 21:11:06.171434 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 21:11:06.171434 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 21:11:06.171434 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 21:11:06.171434 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bff085f-5477-4588-9e08-533189d2db08 could not be found. May 31 21:11:06.171434 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:11:06.171434 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:11:06.171434 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:11:06.171434 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:11:06.171434 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:11:06.171434 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:11:06.171434 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 21:11:06.171434 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 21:11:06.171434 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 21:11:06.172619 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 21:11:06.172619 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 21:11:06.172619 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 21:11:06.172619 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 21:11:06.172619 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 21:11:06.172619 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 21:11:06.172619 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 21:11:06.172619 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bff085f-5477-4588-9e08-533189d2db08 could not be found. May 31 21:11:06.172619 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:11:06.172619 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:11:06.172619 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:11:06.172619 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:11:06.172619 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:11:06.172619 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:11:06.172619 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 21:11:06.172619 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 21:11:06.172619 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bff085f-5477-4588-9e08-533189d2db08 could not be found. May 31 21:11:06.172619 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:11:06.173674 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-91d8d8af-68a6-43d5-bc38-435ea092b973 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Returning 404 to user: Instance 9bff085f-5477-4588-9e08-533189d2db08 could not be found. {{(pid=118184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 21:11:06.173674 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-91d8d8af-68a6-43d5-bc38-435ea092b973 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08" status: 404 len: 111 microversion: 2.1 time: 0.034041 May 31 21:11:06.173674 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 413/792] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:11:06 2022] GET /compute/v2.1/servers/9bff085f-5477-4588-9e08-533189d2db08 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 21:11:06.179421 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-4e740d77-f16c-4b49-8c5c-66dc63d2d0c7 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:11:06.179940 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-4e740d77-f16c-4b49-8c5c-66dc63d2d0c7 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 24059932-87a0-4e56-8bb0-4797276e2042] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:11:06.189182 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4e740d77-f16c-4b49-8c5c-66dc63d2d0c7 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:06.191904 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4e740d77-f16c-4b49-8c5c-66dc63d2d0c7 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:06.191904 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4e740d77-f16c-4b49-8c5c-66dc63d2d0c7 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:06.191904 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4e740d77-f16c-4b49-8c5c-66dc63d2d0c7 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:06.197881 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:11:06.229956 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-4e740d77-f16c-4b49-8c5c-66dc63d2d0c7 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 24059932-87a0-4e56-8bb0-4797276e2042] Going to try to terminate instance {{(pid=118185) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 21:11:06.447238 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [req-27433e72-b223-4b72-88c0-75e85876fcde req-ba9dfe6a-9798-4916-90b2-3d83fb75e3ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e26c2265-9a33-4c2a-9e41-6bf685f4c525", "tag": "04ab265f-077c-4c29-bea4-68787d93131b"}]} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:11:06.457207 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-27433e72-b223-4b72-88c0-75e85876fcde req-ba9dfe6a-9798-4916-90b2-3d83fb75e3ad service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:06.457657 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-27433e72-b223-4b72-88c0-75e85876fcde req-ba9dfe6a-9798-4916-90b2-3d83fb75e3ad service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:06.470181 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.compute.server_external_events [req-27433e72-b223-4b72-88c0-75e85876fcde req-ba9dfe6a-9798-4916-90b2-3d83fb75e3ad service nova] Creating event network-changed:04ab265f-077c-4c29-bea4-68787d93131b for instance e26c2265-9a33-4c2a-9e41-6bf685f4c525 on hv-cinder-83979 May 31 21:11:06.475383 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [req-27433e72-b223-4b72-88c0-75e85876fcde req-ba9dfe6a-9798-4916-90b2-3d83fb75e3ad service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032579 May 31 21:11:06.476656 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 414/793] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:11:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:11:06.653262 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-4e740d77-f16c-4b49-8c5c-66dc63d2d0c7 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "DELETE /compute/v2.1/servers/24059932-87a0-4e56-8bb0-4797276e2042" status: 204 len: 0 microversion: 2.1 time: 0.477635 May 31 21:11:06.653856 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 380/794] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 31 21:11:06 2022] DELETE /compute/v2.1/servers/24059932-87a0-4e56-8bb0-4797276e2042 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 31 21:11:06.669462 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-f88b3e14-c906-4297-a47c-99a55fa5aa80 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:11:06.670185 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-f88b3e14-c906-4297-a47c-99a55fa5aa80 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 24059932-87a0-4e56-8bb0-4797276e2042] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:11:06.676355 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f88b3e14-c906-4297-a47c-99a55fa5aa80 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:06.676798 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f88b3e14-c906-4297-a47c-99a55fa5aa80 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:06.677553 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f88b3e14-c906-4297-a47c-99a55fa5aa80 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:06.678011 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f88b3e14-c906-4297-a47c-99a55fa5aa80 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:06.815545 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-f88b3e14-c906-4297-a47c-99a55fa5aa80 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:06.823289 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-f88b3e14-c906-4297-a47c-99a55fa5aa80 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/24059932-87a0-4e56-8bb0-4797276e2042" status: 200 len: 1523 microversion: 2.1 time: 0.157997 May 31 21:11:06.823853 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 415/795] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:11:06 2022] GET /compute/v2.1/servers/24059932-87a0-4e56-8bb0-4797276e2042 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:11:06.889856 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-676324aa-382f-4134-81fc-98cc7c129fe0 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:11:06.890692 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-676324aa-382f-4134-81fc-98cc7c129fe0 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: e26c2265-9a33-4c2a-9e41-6bf685f4c525] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:11:06.897457 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-676324aa-382f-4134-81fc-98cc7c129fe0 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:06.897930 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-676324aa-382f-4134-81fc-98cc7c129fe0 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:06.898710 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-676324aa-382f-4134-81fc-98cc7c129fe0 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:06.899149 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-676324aa-382f-4134-81fc-98cc7c129fe0 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:07.030978 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-676324aa-382f-4134-81fc-98cc7c129fe0 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:07.038427 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-676324aa-382f-4134-81fc-98cc7c129fe0 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525" status: 200 len: 1362 microversion: 2.1 time: 0.153327 May 31 21:11:07.039000 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 381/796] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:11:06 2022] GET /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:11:07.840827 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-fe18684c-d156-4017-ad07-879d6fed3685 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:11:07.842340 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-fe18684c-d156-4017-ad07-879d6fed3685 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 24059932-87a0-4e56-8bb0-4797276e2042] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:11:07.848785 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-fe18684c-d156-4017-ad07-879d6fed3685 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:07.849240 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-fe18684c-d156-4017-ad07-879d6fed3685 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:07.850052 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-fe18684c-d156-4017-ad07-879d6fed3685 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:07.850642 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-fe18684c-d156-4017-ad07-879d6fed3685 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:07.920641 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-fe18684c-d156-4017-ad07-879d6fed3685 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:07.928063 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-fe18684c-d156-4017-ad07-879d6fed3685 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/24059932-87a0-4e56-8bb0-4797276e2042" status: 200 len: 1481 microversion: 2.1 time: 0.091483 May 31 21:11:07.928623 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 416/797] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:11:07 2022] GET /compute/v2.1/servers/24059932-87a0-4e56-8bb0-4797276e2042 => generated 1481 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:11:08.055218 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-7e53b175-ede5-462f-8b37-ddf314ed9446 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:11:08.055831 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-7e53b175-ede5-462f-8b37-ddf314ed9446 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: e26c2265-9a33-4c2a-9e41-6bf685f4c525] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:11:08.062373 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-7e53b175-ede5-462f-8b37-ddf314ed9446 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:08.062822 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-7e53b175-ede5-462f-8b37-ddf314ed9446 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:08.063592 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-7e53b175-ede5-462f-8b37-ddf314ed9446 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:08.064030 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-7e53b175-ede5-462f-8b37-ddf314ed9446 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:08.195848 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-7e53b175-ede5-462f-8b37-ddf314ed9446 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:08.203552 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-7e53b175-ede5-462f-8b37-ddf314ed9446 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525" status: 200 len: 1362 microversion: 2.1 time: 0.152120 May 31 21:11:08.204135 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 382/798] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:11:08 2022] GET /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:11:08.492092 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [req-cc1808a2-65a7-4f43-88d6-e8679285c81f req-152ff189-cc59-4905-ab1b-be2784359446 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24059932-87a0-4e56-8bb0-4797276e2042", "name": "network-vif-deleted", "tag": "d441d5e6-2812-4d1f-bf38-96cb2c781ded"}]} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:11:08.500217 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-cc1808a2-65a7-4f43-88d6-e8679285c81f req-152ff189-cc59-4905-ab1b-be2784359446 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:08.500660 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-cc1808a2-65a7-4f43-88d6-e8679285c81f req-152ff189-cc59-4905-ab1b-be2784359446 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:08.512002 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.compute.server_external_events [req-cc1808a2-65a7-4f43-88d6-e8679285c81f req-152ff189-cc59-4905-ab1b-be2784359446 service nova] Creating event network-vif-deleted:d441d5e6-2812-4d1f-bf38-96cb2c781ded for instance 24059932-87a0-4e56-8bb0-4797276e2042 on hv-cinder-83979 May 31 21:11:08.516899 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [req-cc1808a2-65a7-4f43-88d6-e8679285c81f req-152ff189-cc59-4905-ab1b-be2784359446 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028589 May 31 21:11:08.517473 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 417/799] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:11:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:11:08.944680 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-5c76a483-8d7a-4a03-913f-8501bbb0ba48 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:11:08.945924 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-5c76a483-8d7a-4a03-913f-8501bbb0ba48 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 24059932-87a0-4e56-8bb0-4797276e2042] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:11:08.951897 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-5c76a483-8d7a-4a03-913f-8501bbb0ba48 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:08.952346 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-5c76a483-8d7a-4a03-913f-8501bbb0ba48 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:08.953115 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-5c76a483-8d7a-4a03-913f-8501bbb0ba48 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:08.953550 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-5c76a483-8d7a-4a03-913f-8501bbb0ba48 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:09.013769 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-5c76a483-8d7a-4a03-913f-8501bbb0ba48 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:09.021223 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-5c76a483-8d7a-4a03-913f-8501bbb0ba48 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/24059932-87a0-4e56-8bb0-4797276e2042" status: 200 len: 1481 microversion: 2.1 time: 0.080530 May 31 21:11:09.021787 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 383/800] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:11:08 2022] GET /compute/v2.1/servers/24059932-87a0-4e56-8bb0-4797276e2042 => generated 1481 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:11:09.218841 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell0:SELECT=4 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:11:09.223125 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-e4ea2596-998f-4258-82e6-d68109831193 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:11:09.223815 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-e4ea2596-998f-4258-82e6-d68109831193 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: e26c2265-9a33-4c2a-9e41-6bf685f4c525] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:11:09.230047 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e4ea2596-998f-4258-82e6-d68109831193 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:09.230514 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e4ea2596-998f-4258-82e6-d68109831193 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:09.231251 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e4ea2596-998f-4258-82e6-d68109831193 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:09.231682 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e4ea2596-998f-4258-82e6-d68109831193 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:09.361927 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-e4ea2596-998f-4258-82e6-d68109831193 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:09.369265 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-e4ea2596-998f-4258-82e6-d68109831193 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525" status: 200 len: 1362 microversion: 2.1 time: 0.152244 May 31 21:11:09.369832 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 418/801] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:11:09 2022] GET /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:11:10.037881 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-ca052c5b-e17a-48d4-8d37-ebc24c857c58 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:11:10.038447 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-ca052c5b-e17a-48d4-8d37-ebc24c857c58 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 24059932-87a0-4e56-8bb0-4797276e2042] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:11:10.045392 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ca052c5b-e17a-48d4-8d37-ebc24c857c58 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:10.045841 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ca052c5b-e17a-48d4-8d37-ebc24c857c58 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:10.046637 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ca052c5b-e17a-48d4-8d37-ebc24c857c58 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:10.047073 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ca052c5b-e17a-48d4-8d37-ebc24c857c58 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:10.078453 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ca052c5b-e17a-48d4-8d37-ebc24c857c58 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:10.078906 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ca052c5b-e17a-48d4-8d37-ebc24c857c58 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:10.079357 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.objects.instance [None req-ca052c5b-e17a-48d4-8d37-ebc24c857c58 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lazy-loading 'fault' on Instance uuid 24059932-87a0-4e56-8bb0-4797276e2042 {{(pid=118185) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 21:11:10.122326 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-ca052c5b-e17a-48d4-8d37-ebc24c857c58 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf377756836405d804d2aaba6e44c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b54ceb69fc4041b743a11eda4144a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:10.129731 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-ca052c5b-e17a-48d4-8d37-ebc24c857c58 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/24059932-87a0-4e56-8bb0-4797276e2042" status: 200 len: 1312 microversion: 2.1 time: 0.095824 May 31 21:11:10.130336 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 384/802] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:11:10 2022] GET /compute/v2.1/servers/24059932-87a0-4e56-8bb0-4797276e2042 => generated 1312 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:11:10.385620 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-473b2474-10e8-4268-a59d-da437b4f3bcf tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:11:10.386253 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-473b2474-10e8-4268-a59d-da437b4f3bcf tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: e26c2265-9a33-4c2a-9e41-6bf685f4c525] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:11:10.392889 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-473b2474-10e8-4268-a59d-da437b4f3bcf tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:10.393362 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-473b2474-10e8-4268-a59d-da437b4f3bcf tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:10.394161 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-473b2474-10e8-4268-a59d-da437b4f3bcf tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:10.394592 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-473b2474-10e8-4268-a59d-da437b4f3bcf tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:10.531002 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-473b2474-10e8-4268-a59d-da437b4f3bcf tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:10.538422 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-473b2474-10e8-4268-a59d-da437b4f3bcf tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525" status: 200 len: 1362 microversion: 2.1 time: 0.156701 May 31 21:11:10.538981 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 419/803] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:11:10 2022] GET /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:11:11.146873 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-be092826-f7a7-4cb5-8ba9-e3a88c1b02b7 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:11:11.147417 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-be092826-f7a7-4cb5-8ba9-e3a88c1b02b7 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] [instance: 24059932-87a0-4e56-8bb0-4797276e2042] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:11:11.154150 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-be092826-f7a7-4cb5-8ba9-e3a88c1b02b7 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:11.154601 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-be092826-f7a7-4cb5-8ba9-e3a88c1b02b7 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:11.155367 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-be092826-f7a7-4cb5-8ba9-e3a88c1b02b7 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:11.155799 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-be092826-f7a7-4cb5-8ba9-e3a88c1b02b7 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:11.168826 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.wsgi [None req-be092826-f7a7-4cb5-8ba9-e3a88c1b02b7 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] HTTP exception thrown: Instance 24059932-87a0-4e56-8bb0-4797276e2042 could not be found. May 31 21:11:11.170492 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-be092826-f7a7-4cb5-8ba9-e3a88c1b02b7 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Request method failure captured: May 31 21:11:11.170492 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: request: GET /compute/v2.1/servers/24059932-87a0-4e56-8bb0-4797276e2042 HTTP/1.1 May 31 21:11:11.170492 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Accept: application/json May 31 21:11:11.170492 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Accept-Encoding: identity May 31 21:11:11.170492 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Connection: close May 31 21:11:11.170492 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Content-Length: 0 May 31 21:11:11.170492 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Content-Type: application/json May 31 21:11:11.170492 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Host: 10.222.0.55 May 31 21:11:11.170492 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Openstack-System-Scope: None May 31 21:11:11.170492 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: User-Agent: python-urllib3/1.26.9 May 31 21:11:11.170492 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Auth-Token: gAAAAABiloKngpou4fcrhJSECdfOHFsnMzu14lCOGutNAWHrekz0pgYMq4g1wmFaJxYB11cNdAFG04NttpTVQ0IQX971BK1KwyKsW5u5cbGZqnRRimaXJ-Df08ghf2T6DQWELhQSwIrMDVTC_eNXuZkmjTncSbGwdASXfJc-kC3SbyJrBM1jos4 May 31 21:11:11.170492 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Domain-Id: None May 31 21:11:11.170492 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Domain-Name: None May 31 21:11:11.170492 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Identity-Status: Confirmed May 31 21:11:11.170492 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Is-Admin-Project: True May 31 21:11:11.170492 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Domain-Id: default May 31 21:11:11.170492 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Domain-Name: Default May 31 21:11:11.170492 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Id: f1b54ceb69fc4041b743a11eda4144a8 May 31 21:11:11.170492 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1103944919 May 31 21:11:11.170492 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Role: member,reader May 31 21:11:11.170492 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Roles: member,reader May 31 21:11:11.172021 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/f1b54ceb69fc4041b743a11eda4144a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f1b54ceb69fc4041b743a11eda4144a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_f1b54ceb69fc4041b743a11eda4144a8", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f1b54ceb69fc4041b743a11eda4144a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] May 31 21:11:11.172021 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1103944919 May 31 21:11:11.172021 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant-Id: f1b54ceb69fc4041b743a11eda4144a8 May 31 21:11:11.172021 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1103944919 May 31 21:11:11.172021 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User: tempest-ServerRescueNegativeTestJSON-1103944919-project May 31 21:11:11.172021 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Domain-Id: default May 31 21:11:11.172021 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Domain-Name: Default May 31 21:11:11.172021 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Id: bbf377756836405d804d2aaba6e44c1f May 31 21:11:11.172021 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1103944919-project May 31 21:11:11.172021 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: method: > May 31 21:11:11.172021 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: exception: Instance 24059932-87a0-4e56-8bb0-4797276e2042 could not be found. May 31 21:11:11.172021 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: action_args: {'id': '24059932-87a0-4e56-8bb0-4797276e2042'} May 31 21:11:11.172822 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 21:11:11.172822 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:11:11.172822 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 21:11:11.172822 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 21:11:11.172822 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 21:11:11.172822 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 21:11:11.172822 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 21:11:11.172822 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 21:11:11.172822 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 21:11:11.172822 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 21:11:11.172822 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24059932-87a0-4e56-8bb0-4797276e2042 could not be found. May 31 21:11:11.172822 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:11:11.172822 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:11:11.172822 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:11:11.172822 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:11:11.172822 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:11:11.172822 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:11:11.172822 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 21:11:11.172822 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 21:11:11.172822 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 21:11:11.174057 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 21:11:11.174057 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 21:11:11.174057 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 21:11:11.174057 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 21:11:11.174057 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 21:11:11.174057 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 21:11:11.174057 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 21:11:11.174057 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24059932-87a0-4e56-8bb0-4797276e2042 could not be found. May 31 21:11:11.174057 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:11:11.174057 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:11:11.174057 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:11:11.174057 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:11:11.174057 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:11:11.174057 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:11:11.174057 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 21:11:11.174057 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 21:11:11.174057 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24059932-87a0-4e56-8bb0-4797276e2042 could not be found. May 31 21:11:11.174057 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:11:11.175319 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-be092826-f7a7-4cb5-8ba9-e3a88c1b02b7 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] Returning 404 to user: Instance 24059932-87a0-4e56-8bb0-4797276e2042 could not be found. {{(pid=118185) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 21:11:11.175319 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-be092826-f7a7-4cb5-8ba9-e3a88c1b02b7 tempest-ServerRescueNegativeTestJSON-1103944919 tempest-ServerRescueNegativeTestJSON-1103944919-project] 10.222.0.55 "GET /compute/v2.1/servers/24059932-87a0-4e56-8bb0-4797276e2042" status: 404 len: 111 microversion: 2.1 time: 0.028963 May 31 21:11:11.175319 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 385/804] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:11:11 2022] GET /compute/v2.1/servers/24059932-87a0-4e56-8bb0-4797276e2042 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 21:11:11.555518 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-30e3999b-7653-4272-87ec-e2c76d0fb0b0 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:11:11.556131 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-30e3999b-7653-4272-87ec-e2c76d0fb0b0 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: e26c2265-9a33-4c2a-9e41-6bf685f4c525] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:11:11.562882 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-30e3999b-7653-4272-87ec-e2c76d0fb0b0 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:11.563337 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-30e3999b-7653-4272-87ec-e2c76d0fb0b0 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:11.564164 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-30e3999b-7653-4272-87ec-e2c76d0fb0b0 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:11.564760 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-30e3999b-7653-4272-87ec-e2c76d0fb0b0 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:11.779220 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-30e3999b-7653-4272-87ec-e2c76d0fb0b0 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:11.786741 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-30e3999b-7653-4272-87ec-e2c76d0fb0b0 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525" status: 200 len: 1362 microversion: 2.1 time: 0.235678 May 31 21:11:11.787547 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 420/805] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:11:11 2022] GET /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525 => generated 1362 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:11:12.803805 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-238ed3ae-c3dc-4530-a4f9-c0d959ff991c tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:11:12.804394 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-238ed3ae-c3dc-4530-a4f9-c0d959ff991c tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: e26c2265-9a33-4c2a-9e41-6bf685f4c525] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:11:12.807408 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell0:SELECT=2 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:11:12.808228 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell0:SELECT=8 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:11:12.813067 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-238ed3ae-c3dc-4530-a4f9-c0d959ff991c tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:12.813528 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-238ed3ae-c3dc-4530-a4f9-c0d959ff991c tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:12.814421 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-238ed3ae-c3dc-4530-a4f9-c0d959ff991c tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:12.814854 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-238ed3ae-c3dc-4530-a4f9-c0d959ff991c tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:13.049698 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-238ed3ae-c3dc-4530-a4f9-c0d959ff991c tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:13.059985 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-238ed3ae-c3dc-4530-a4f9-c0d959ff991c tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525" status: 200 len: 1362 microversion: 2.1 time: 0.260114 May 31 21:11:13.061239 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 386/806] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:11:12 2022] GET /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525 => generated 1362 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:11:14.080895 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-f5574bec-e5e5-4328-90f7-999011055d36 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:11:14.082262 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-f5574bec-e5e5-4328-90f7-999011055d36 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: e26c2265-9a33-4c2a-9e41-6bf685f4c525] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:11:14.091770 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f5574bec-e5e5-4328-90f7-999011055d36 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:14.092215 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f5574bec-e5e5-4328-90f7-999011055d36 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:14.093160 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f5574bec-e5e5-4328-90f7-999011055d36 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:14.093750 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f5574bec-e5e5-4328-90f7-999011055d36 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:14.266615 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-f5574bec-e5e5-4328-90f7-999011055d36 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:14.275291 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-f5574bec-e5e5-4328-90f7-999011055d36 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525" status: 200 len: 1362 microversion: 2.1 time: 0.201952 May 31 21:11:14.286337 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 421/807] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:11:14 2022] GET /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525 => generated 1362 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:11:14.844267 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [req-664f52da-398d-4d3c-9a6e-2906f40e2b81 req-509610f8-ec05-4a8e-b299-1b82a8401740 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e26c2265-9a33-4c2a-9e41-6bf685f4c525", "name": "network-vif-plugged", "status": "completed", "tag": "04ab265f-077c-4c29-bea4-68787d93131b"}]} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:11:14.863486 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-664f52da-398d-4d3c-9a6e-2906f40e2b81 req-509610f8-ec05-4a8e-b299-1b82a8401740 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:14.863935 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-664f52da-398d-4d3c-9a6e-2906f40e2b81 req-509610f8-ec05-4a8e-b299-1b82a8401740 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:14.878470 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.compute.server_external_events [req-664f52da-398d-4d3c-9a6e-2906f40e2b81 req-509610f8-ec05-4a8e-b299-1b82a8401740 service nova] Creating event network-vif-plugged:04ab265f-077c-4c29-bea4-68787d93131b for instance e26c2265-9a33-4c2a-9e41-6bf685f4c525 on hv-cinder-83979 May 31 21:11:14.884344 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [req-664f52da-398d-4d3c-9a6e-2906f40e2b81 req-509610f8-ec05-4a8e-b299-1b82a8401740 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044342 May 31 21:11:14.889334 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 387/808] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:11:15.293002 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-8f942acd-c7c0-4b95-bb39-5debfa2d5019 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:11:15.293603 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-8f942acd-c7c0-4b95-bb39-5debfa2d5019 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: e26c2265-9a33-4c2a-9e41-6bf685f4c525] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:11:15.300004 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-8f942acd-c7c0-4b95-bb39-5debfa2d5019 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:15.300459 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-8f942acd-c7c0-4b95-bb39-5debfa2d5019 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:15.301217 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-8f942acd-c7c0-4b95-bb39-5debfa2d5019 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:15.301665 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-8f942acd-c7c0-4b95-bb39-5debfa2d5019 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:15.432895 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-8f942acd-c7c0-4b95-bb39-5debfa2d5019 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:15.440610 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-8f942acd-c7c0-4b95-bb39-5debfa2d5019 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525" status: 200 len: 1362 microversion: 2.1 time: 0.151932 May 31 21:11:15.441186 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 422/809] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:11:15 2022] GET /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:11:16.457550 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-8b8e04b4-60fb-4cfe-b6fb-54f3ec231b9d tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:11:16.459810 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-8b8e04b4-60fb-4cfe-b6fb-54f3ec231b9d tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: e26c2265-9a33-4c2a-9e41-6bf685f4c525] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:11:16.466816 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-8b8e04b4-60fb-4cfe-b6fb-54f3ec231b9d tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:16.467254 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-8b8e04b4-60fb-4cfe-b6fb-54f3ec231b9d tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:16.468173 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-8b8e04b4-60fb-4cfe-b6fb-54f3ec231b9d tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:16.468614 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-8b8e04b4-60fb-4cfe-b6fb-54f3ec231b9d tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:16.610580 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-8b8e04b4-60fb-4cfe-b6fb-54f3ec231b9d tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:16.618408 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-8b8e04b4-60fb-4cfe-b6fb-54f3ec231b9d tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525" status: 200 len: 1362 microversion: 2.1 time: 0.165476 May 31 21:11:16.618972 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 388/810] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:11:16 2022] GET /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:11:17.636076 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-29e71c7a-f8d1-431a-84fa-dbba42d05770 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:11:17.636632 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-29e71c7a-f8d1-431a-84fa-dbba42d05770 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: e26c2265-9a33-4c2a-9e41-6bf685f4c525] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:11:17.643360 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-29e71c7a-f8d1-431a-84fa-dbba42d05770 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:17.643811 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-29e71c7a-f8d1-431a-84fa-dbba42d05770 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:17.644719 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-29e71c7a-f8d1-431a-84fa-dbba42d05770 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:17.645348 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-29e71c7a-f8d1-431a-84fa-dbba42d05770 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:18.034787 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-29e71c7a-f8d1-431a-84fa-dbba42d05770 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:18.043411 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-29e71c7a-f8d1-431a-84fa-dbba42d05770 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525" status: 200 len: 1548 microversion: 2.1 time: 0.411960 May 31 21:11:18.043986 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 423/811] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:11:17 2022] GET /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525 => generated 1548 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:11:18.061284 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-0d532f76-196f-4870-8b4b-a93c223c1ad3 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:11:18.061815 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-0d532f76-196f-4870-8b4b-a93c223c1ad3 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: e26c2265-9a33-4c2a-9e41-6bf685f4c525] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:11:18.068744 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-0d532f76-196f-4870-8b4b-a93c223c1ad3 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:18.069196 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-0d532f76-196f-4870-8b4b-a93c223c1ad3 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:18.070016 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-0d532f76-196f-4870-8b4b-a93c223c1ad3 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:18.070451 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-0d532f76-196f-4870-8b4b-a93c223c1ad3 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:18.149626 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-0d532f76-196f-4870-8b4b-a93c223c1ad3 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092932 May 31 21:11:18.150254 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 389/812] 10.222.0.55 () {58 vars in 1274 bytes} [Tue May 31 21:11:18 2022] GET /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:11:19.504720 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [req-69267c00-68f4-4efe-9a22-575011068474 req-8775d30b-4db7-454f-be1c-2deda355c1e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e26c2265-9a33-4c2a-9e41-6bf685f4c525", "tag": "04ab265f-077c-4c29-bea4-68787d93131b"}]} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:11:19.509409 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:11:19.514896 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-69267c00-68f4-4efe-9a22-575011068474 req-8775d30b-4db7-454f-be1c-2deda355c1e5 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:19.515414 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-69267c00-68f4-4efe-9a22-575011068474 req-8775d30b-4db7-454f-be1c-2deda355c1e5 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:19.527571 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.compute.server_external_events [req-69267c00-68f4-4efe-9a22-575011068474 req-8775d30b-4db7-454f-be1c-2deda355c1e5 service nova] Creating event network-changed:04ab265f-077c-4c29-bea4-68787d93131b for instance e26c2265-9a33-4c2a-9e41-6bf685f4c525 on hv-cinder-83979 May 31 21:11:19.532869 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [req-69267c00-68f4-4efe-9a22-575011068474 req-8775d30b-4db7-454f-be1c-2deda355c1e5 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031810 May 31 21:11:19.533654 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 424/813] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:11:22.601334 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-db40a461-c93e-4028-91dd-c099b0a3ced7 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Action: 'create', calling method: .version_select at 0x7fe7c5f96f70>, body: {"keypair": {"name": "tempest-keypair-193533202", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC74+DLcJmH65AQTlvfPPRaASu37T6dk9jO5+SL1lCPGBx1I1bskKEe4s9R4BN7kv8IucgoBEDaewi7iE17XVEgAbG3cudrklT69hzFyz2+gl4vpZbauQNIwNbgdbgz5ug=="}} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:11:22.605527 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:11:22.616793 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.quota [None req-db40a461-c93e-4028-91dd-c099b0a3ced7 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Getting quotas for project 69b2364f40d14160adf0220d92adaad7. Resources: {'key_pairs'} {{(pid=118185) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 21:11:22.620866 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.quota [None req-db40a461-c93e-4028-91dd-c099b0a3ced7 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Getting quotas for user 8efe37a6d57b4775b4e47a295c3f5eee and project 69b2364f40d14160adf0220d92adaad7. Resources: {'key_pairs'} {{(pid=118185) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 21:11:22.735246 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-db40a461-c93e-4028-91dd-c099b0a3ced7 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.251276 May 31 21:11:22.736232 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 390/814] 10.222.0.55 () {60 vars in 1158 bytes} [Tue May 31 21:11:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:11:25.287785 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-fd7f7834-2e3e-4c8a-94ba-368df9fc0611 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1125433886", "imageRef": "21b89996-9e87-489d-8891-305f6c3d905a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f9f27def-cef7-45b6-9a7b-b0c954078818"}], "security_groups": [{"name": "tempest-securitygroup--1644503881"}], "key_name": "tempest-keypair-193533202", "user_data": "}} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:11:25.411616 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.network.neutron [None req-fd7f7834-2e3e-4c8a-94ba-368df9fc0611 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] validate_networks() for [('f9f27def-cef7-45b6-9a7b-b0c954078818', None, None, None, None, None)] {{(pid=118184) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 21:11:25.884719 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.virt.hardware [None req-fd7f7834-2e3e-4c8a-94ba-368df9fc0611 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Flavor limits 0:0:0 {{(pid=118184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 21:11:25.885146 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.virt.hardware [None req-fd7f7834-2e3e-4c8a-94ba-368df9fc0611 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Image limits 0:0:0 {{(pid=118184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 21:11:25.885695 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.virt.hardware [None req-fd7f7834-2e3e-4c8a-94ba-368df9fc0611 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Flavor pref 0:0:0 {{(pid=118184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 21:11:25.886137 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.virt.hardware [None req-fd7f7834-2e3e-4c8a-94ba-368df9fc0611 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Image pref 0:0:0 {{(pid=118184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 21:11:25.886557 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.virt.hardware [None req-fd7f7834-2e3e-4c8a-94ba-368df9fc0611 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 21:11:25.901113 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-fd7f7834-2e3e-4c8a-94ba-368df9fc0611 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:25.901564 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-fd7f7834-2e3e-4c8a-94ba-368df9fc0611 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:25.902402 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-fd7f7834-2e3e-4c8a-94ba-368df9fc0611 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:25.903224 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-fd7f7834-2e3e-4c8a-94ba-368df9fc0611 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:25.928870 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.quota [None req-fd7f7834-2e3e-4c8a-94ba-368df9fc0611 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Getting quotas for project 69b2364f40d14160adf0220d92adaad7. Resources: {'ram', 'cores', 'instances'} {{(pid=118184) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 21:11:25.930317 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.quota [None req-fd7f7834-2e3e-4c8a-94ba-368df9fc0611 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Getting quotas for user 8efe37a6d57b4775b4e47a295c3f5eee and project 69b2364f40d14160adf0220d92adaad7. Resources: {'ram', 'cores', 'instances'} {{(pid=118184) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 21:11:25.943518 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-fd7f7834-2e3e-4c8a-94ba-368df9fc0611 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Going to run 1 instances... {{(pid=118184) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 21:11:25.948114 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-fd7f7834-2e3e-4c8a-94ba-368df9fc0611 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 5cb669a7-8e63-46ac-86f6-1be4050a44ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='21b89996-9e87-489d-8891-305f6c3d905a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118184) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 21:11:26.122855 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-fd7f7834-2e3e-4c8a-94ba-368df9fc0611 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.842240 May 31 21:11:26.123525 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 425/815] 10.222.0.55 () {60 vars in 1146 bytes} [Tue May 31 21:11:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 845 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 31 21:11:26.135428 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-5eb10534-9c8c-4cb7-8cee-671b5ab1f56c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:11:26.137604 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-5eb10534-9c8c-4cb7-8cee-671b5ab1f56c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 5cb669a7-8e63-46ac-86f6-1be4050a44ec] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:11:26.213980 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-5eb10534-9c8c-4cb7-8cee-671b5ab1f56c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe37a6d57b4775b4e47a295c3f5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b2364f40d14160adf0220d92adaad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:26.221848 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-5eb10534-9c8c-4cb7-8cee-671b5ab1f56c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec" status: 200 len: 1241 microversion: 2.1 time: 0.092030 May 31 21:11:26.223387 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 391/816] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:11:26 2022] GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec => generated 1241 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:11:27.239905 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-6fd4ccb5-9030-44c1-b36d-68dc0e5a576d tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:11:27.240508 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-6fd4ccb5-9030-44c1-b36d-68dc0e5a576d tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 5cb669a7-8e63-46ac-86f6-1be4050a44ec] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:11:27.247209 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6fd4ccb5-9030-44c1-b36d-68dc0e5a576d tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:27.247655 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6fd4ccb5-9030-44c1-b36d-68dc0e5a576d tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:27.248477 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6fd4ccb5-9030-44c1-b36d-68dc0e5a576d tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:27.248916 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6fd4ccb5-9030-44c1-b36d-68dc0e5a576d tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:27.309474 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-6fd4ccb5-9030-44c1-b36d-68dc0e5a576d tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe37a6d57b4775b4e47a295c3f5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b2364f40d14160adf0220d92adaad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:27.316854 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-6fd4ccb5-9030-44c1-b36d-68dc0e5a576d tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec" status: 200 len: 1245 microversion: 2.1 time: 0.081399 May 31 21:11:27.317410 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 426/817] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:11:27 2022] GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:11:28.334198 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-8b071f78-b7ec-4417-a05b-af63d77aa8e2 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:11:28.334754 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-8b071f78-b7ec-4417-a05b-af63d77aa8e2 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 5cb669a7-8e63-46ac-86f6-1be4050a44ec] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:11:28.337455 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:11:28.342481 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-8b071f78-b7ec-4417-a05b-af63d77aa8e2 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:28.342960 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-8b071f78-b7ec-4417-a05b-af63d77aa8e2 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:28.343726 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-8b071f78-b7ec-4417-a05b-af63d77aa8e2 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:28.344161 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-8b071f78-b7ec-4417-a05b-af63d77aa8e2 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:28.408224 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-8b071f78-b7ec-4417-a05b-af63d77aa8e2 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe37a6d57b4775b4e47a295c3f5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b2364f40d14160adf0220d92adaad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:28.416553 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-8b071f78-b7ec-4417-a05b-af63d77aa8e2 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec" status: 200 len: 1293 microversion: 2.1 time: 0.086585 May 31 21:11:28.417136 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 392/818] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:11:28 2022] GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec => generated 1293 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:11:29.434488 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-816cc740-8ee3-42f2-aea9-573832954d33 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:11:29.435919 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-816cc740-8ee3-42f2-aea9-573832954d33 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 5cb669a7-8e63-46ac-86f6-1be4050a44ec] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:11:29.442466 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-816cc740-8ee3-42f2-aea9-573832954d33 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:29.442915 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-816cc740-8ee3-42f2-aea9-573832954d33 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:29.443690 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-816cc740-8ee3-42f2-aea9-573832954d33 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:29.444120 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-816cc740-8ee3-42f2-aea9-573832954d33 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:29.578083 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-816cc740-8ee3-42f2-aea9-573832954d33 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe37a6d57b4775b4e47a295c3f5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b2364f40d14160adf0220d92adaad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:29.587203 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-816cc740-8ee3-42f2-aea9-573832954d33 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec" status: 200 len: 1367 microversion: 2.1 time: 0.156672 May 31 21:11:29.587829 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 427/819] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:11:29 2022] GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:11:30.312232 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [req-fd216600-7a05-4bbc-aa85-087219f46832 req-bada9081-5682-44f1-8d7d-17d1b3b56fb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cb669a7-8e63-46ac-86f6-1be4050a44ec", "tag": "e802cc62-ebe6-41ff-a0a9-e0f9038c9831"}]} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:11:30.325379 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-fd216600-7a05-4bbc-aa85-087219f46832 req-bada9081-5682-44f1-8d7d-17d1b3b56fb1 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:30.325800 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-fd216600-7a05-4bbc-aa85-087219f46832 req-bada9081-5682-44f1-8d7d-17d1b3b56fb1 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:30.339059 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.compute.server_external_events [req-fd216600-7a05-4bbc-aa85-087219f46832 req-bada9081-5682-44f1-8d7d-17d1b3b56fb1 service nova] Creating event network-changed:e802cc62-ebe6-41ff-a0a9-e0f9038c9831 for instance 5cb669a7-8e63-46ac-86f6-1be4050a44ec on hv-cinder-83979 May 31 21:11:30.344784 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [req-fd216600-7a05-4bbc-aa85-087219f46832 req-bada9081-5682-44f1-8d7d-17d1b3b56fb1 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043001 May 31 21:11:30.345381 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 393/820] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:11:30.604851 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-a75f1618-68b5-45da-94ef-ff37f6f9834e tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:11:30.605532 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-a75f1618-68b5-45da-94ef-ff37f6f9834e tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 5cb669a7-8e63-46ac-86f6-1be4050a44ec] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:11:30.612448 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a75f1618-68b5-45da-94ef-ff37f6f9834e tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:30.613069 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a75f1618-68b5-45da-94ef-ff37f6f9834e tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:30.613931 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a75f1618-68b5-45da-94ef-ff37f6f9834e tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:30.614501 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a75f1618-68b5-45da-94ef-ff37f6f9834e tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:30.751260 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-a75f1618-68b5-45da-94ef-ff37f6f9834e tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe37a6d57b4775b4e47a295c3f5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b2364f40d14160adf0220d92adaad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:30.766550 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-a75f1618-68b5-45da-94ef-ff37f6f9834e tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec" status: 200 len: 1367 microversion: 2.1 time: 0.165669 May 31 21:11:30.767361 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 428/821] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:11:30 2022] GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:11:31.784815 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-fa988916-67c5-4470-9146-b410d99a1a6c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:11:31.785515 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-fa988916-67c5-4470-9146-b410d99a1a6c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 5cb669a7-8e63-46ac-86f6-1be4050a44ec] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:11:31.792935 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-fa988916-67c5-4470-9146-b410d99a1a6c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:31.793812 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-fa988916-67c5-4470-9146-b410d99a1a6c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:31.794867 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-fa988916-67c5-4470-9146-b410d99a1a6c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:31.795375 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-fa988916-67c5-4470-9146-b410d99a1a6c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:31.925778 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-fa988916-67c5-4470-9146-b410d99a1a6c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe37a6d57b4775b4e47a295c3f5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b2364f40d14160adf0220d92adaad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:31.933195 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-fa988916-67c5-4470-9146-b410d99a1a6c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec" status: 200 len: 1367 microversion: 2.1 time: 0.153504 May 31 21:11:31.933757 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 394/822] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:11:31 2022] GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:11:32.949532 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-834dd6b7-c847-414d-8e0a-7f25745ea301 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:11:32.950169 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-834dd6b7-c847-414d-8e0a-7f25745ea301 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 5cb669a7-8e63-46ac-86f6-1be4050a44ec] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:11:32.956312 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-834dd6b7-c847-414d-8e0a-7f25745ea301 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:32.956762 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-834dd6b7-c847-414d-8e0a-7f25745ea301 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:32.957527 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-834dd6b7-c847-414d-8e0a-7f25745ea301 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:32.957993 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-834dd6b7-c847-414d-8e0a-7f25745ea301 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:33.092245 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-834dd6b7-c847-414d-8e0a-7f25745ea301 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe37a6d57b4775b4e47a295c3f5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b2364f40d14160adf0220d92adaad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:33.099824 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-834dd6b7-c847-414d-8e0a-7f25745ea301 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec" status: 200 len: 1367 microversion: 2.1 time: 0.154013 May 31 21:11:33.100388 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 429/823] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:11:32 2022] GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:11:34.116160 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-b792bb8f-5476-469e-b6e5-faa4fedbeaaa tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:11:34.116811 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-b792bb8f-5476-469e-b6e5-faa4fedbeaaa tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 5cb669a7-8e63-46ac-86f6-1be4050a44ec] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:11:34.124096 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b792bb8f-5476-469e-b6e5-faa4fedbeaaa tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:34.124554 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b792bb8f-5476-469e-b6e5-faa4fedbeaaa tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:34.125327 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b792bb8f-5476-469e-b6e5-faa4fedbeaaa tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:34.125767 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b792bb8f-5476-469e-b6e5-faa4fedbeaaa tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:34.252679 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-b792bb8f-5476-469e-b6e5-faa4fedbeaaa tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe37a6d57b4775b4e47a295c3f5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b2364f40d14160adf0220d92adaad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:34.260636 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-b792bb8f-5476-469e-b6e5-faa4fedbeaaa tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec" status: 200 len: 1367 microversion: 2.1 time: 0.148528 May 31 21:11:34.261193 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 395/824] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:11:34 2022] GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:11:34.617176 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-d2497d65-c532-46aa-b2b4-00f6de397ccb tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:11:34.618301 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-d2497d65-c532-46aa-b2b4-00f6de397ccb tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 92254a91-6b12-4811-a58e-e6f4cac9d965] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:11:34.624671 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d2497d65-c532-46aa-b2b4-00f6de397ccb tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:34.625114 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d2497d65-c532-46aa-b2b4-00f6de397ccb tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:34.625883 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d2497d65-c532-46aa-b2b4-00f6de397ccb tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:34.626335 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d2497d65-c532-46aa-b2b4-00f6de397ccb tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:34.651083 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-d2497d65-c532-46aa-b2b4-00f6de397ccb tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 92254a91-6b12-4811-a58e-e6f4cac9d965] Going to try to terminate instance {{(pid=118184) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 21:11:34.665128 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell1:SELECT=100 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:11:34.989611 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-d2497d65-c532-46aa-b2b4-00f6de397ccb tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "DELETE /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965" status: 204 len: 0 microversion: 2.1 time: 0.375869 May 31 21:11:34.990398 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 430/825] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 31 21:11:34 2022] DELETE /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 31 21:11:34.998493 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-1f86ef6c-81aa-49f5-a1e4-701fbad99900 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:11:34.999134 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-1f86ef6c-81aa-49f5-a1e4-701fbad99900 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 92254a91-6b12-4811-a58e-e6f4cac9d965] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:11:35.005221 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-1f86ef6c-81aa-49f5-a1e4-701fbad99900 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:35.005672 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-1f86ef6c-81aa-49f5-a1e4-701fbad99900 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:35.006477 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-1f86ef6c-81aa-49f5-a1e4-701fbad99900 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:35.006941 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-1f86ef6c-81aa-49f5-a1e4-701fbad99900 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:35.144648 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-1f86ef6c-81aa-49f5-a1e4-701fbad99900 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:35.152394 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-1f86ef6c-81aa-49f5-a1e4-701fbad99900 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965" status: 200 len: 1577 microversion: 2.1 time: 0.157686 May 31 21:11:35.152966 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 396/826] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:11:34 2022] GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965 => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:11:35.278229 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-c303af26-380b-4b41-a39c-7d95bcb9561b tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:11:35.278845 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-c303af26-380b-4b41-a39c-7d95bcb9561b tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 5cb669a7-8e63-46ac-86f6-1be4050a44ec] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:11:35.285073 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c303af26-380b-4b41-a39c-7d95bcb9561b tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:35.285522 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c303af26-380b-4b41-a39c-7d95bcb9561b tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:35.286323 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c303af26-380b-4b41-a39c-7d95bcb9561b tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:35.286756 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c303af26-380b-4b41-a39c-7d95bcb9561b tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:35.417517 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-c303af26-380b-4b41-a39c-7d95bcb9561b tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe37a6d57b4775b4e47a295c3f5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b2364f40d14160adf0220d92adaad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:35.424879 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-c303af26-380b-4b41-a39c-7d95bcb9561b tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec" status: 200 len: 1367 microversion: 2.1 time: 0.151548 May 31 21:11:35.425441 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 431/827] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:11:35 2022] GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:11:36.170482 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-e9b8b058-bc63-4820-9270-f10f5f8106fa tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:11:36.171029 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-e9b8b058-bc63-4820-9270-f10f5f8106fa tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 92254a91-6b12-4811-a58e-e6f4cac9d965] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:11:36.177786 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e9b8b058-bc63-4820-9270-f10f5f8106fa tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:36.178259 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e9b8b058-bc63-4820-9270-f10f5f8106fa tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:36.179019 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e9b8b058-bc63-4820-9270-f10f5f8106fa tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:36.179450 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e9b8b058-bc63-4820-9270-f10f5f8106fa tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:36.219117 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell0:SELECT=6 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:11:36.312406 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-e9b8b058-bc63-4820-9270-f10f5f8106fa tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:36.320060 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-e9b8b058-bc63-4820-9270-f10f5f8106fa tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965" status: 200 len: 1577 microversion: 2.1 time: 0.153583 May 31 21:11:36.320627 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 397/828] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:11:36 2022] GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965 => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:11:36.442200 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-6c3fa7c1-19ad-495a-8ecb-57f5f22df87e tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:11:36.442810 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-6c3fa7c1-19ad-495a-8ecb-57f5f22df87e tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 5cb669a7-8e63-46ac-86f6-1be4050a44ec] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:11:36.445212 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell0:SELECT=2 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:11:36.445927 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell0:SELECT=6 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:11:36.450976 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6c3fa7c1-19ad-495a-8ecb-57f5f22df87e tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:36.451418 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6c3fa7c1-19ad-495a-8ecb-57f5f22df87e tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:36.452172 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6c3fa7c1-19ad-495a-8ecb-57f5f22df87e tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:36.452967 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6c3fa7c1-19ad-495a-8ecb-57f5f22df87e tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:36.583859 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-6c3fa7c1-19ad-495a-8ecb-57f5f22df87e tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe37a6d57b4775b4e47a295c3f5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b2364f40d14160adf0220d92adaad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:36.591866 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-6c3fa7c1-19ad-495a-8ecb-57f5f22df87e tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec" status: 200 len: 1367 microversion: 2.1 time: 0.153563 May 31 21:11:36.592492 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 432/829] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:11:36 2022] GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:11:36.913095 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [req-10abf16b-3780-44c4-9381-d52d1293ac9a req-4d346534-d52a-413d-a058-d4f55b0da317 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cb669a7-8e63-46ac-86f6-1be4050a44ec", "name": "network-vif-plugged", "status": "completed", "tag": "e802cc62-ebe6-41ff-a0a9-e0f9038c9831"}]} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:11:36.921324 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-10abf16b-3780-44c4-9381-d52d1293ac9a req-4d346534-d52a-413d-a058-d4f55b0da317 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:36.921762 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-10abf16b-3780-44c4-9381-d52d1293ac9a req-4d346534-d52a-413d-a058-d4f55b0da317 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:36.933019 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.compute.server_external_events [req-10abf16b-3780-44c4-9381-d52d1293ac9a req-4d346534-d52a-413d-a058-d4f55b0da317 service nova] Creating event network-vif-plugged:e802cc62-ebe6-41ff-a0a9-e0f9038c9831 for instance 5cb669a7-8e63-46ac-86f6-1be4050a44ec on hv-cinder-83979 May 31 21:11:36.938490 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [req-10abf16b-3780-44c4-9381-d52d1293ac9a req-4d346534-d52a-413d-a058-d4f55b0da317 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029018 May 31 21:11:36.939091 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 398/830] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:11:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:11:37.336961 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-b797635c-a013-45f6-b74c-5e95c0e66e40 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:11:37.337509 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-b797635c-a013-45f6-b74c-5e95c0e66e40 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 92254a91-6b12-4811-a58e-e6f4cac9d965] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:11:37.343566 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b797635c-a013-45f6-b74c-5e95c0e66e40 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:37.344011 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b797635c-a013-45f6-b74c-5e95c0e66e40 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:37.344783 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b797635c-a013-45f6-b74c-5e95c0e66e40 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:37.345211 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b797635c-a013-45f6-b74c-5e95c0e66e40 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:37.480775 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-b797635c-a013-45f6-b74c-5e95c0e66e40 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:37.488520 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-b797635c-a013-45f6-b74c-5e95c0e66e40 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965" status: 200 len: 1577 microversion: 2.1 time: 0.155895 May 31 21:11:37.489083 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 433/831] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:11:37 2022] GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965 => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:11:37.611154 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-77e4aa94-0486-4cc4-b915-bfd696ce8221 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:11:37.611986 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-77e4aa94-0486-4cc4-b915-bfd696ce8221 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 5cb669a7-8e63-46ac-86f6-1be4050a44ec] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:11:37.618404 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-77e4aa94-0486-4cc4-b915-bfd696ce8221 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:37.618860 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-77e4aa94-0486-4cc4-b915-bfd696ce8221 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:37.620281 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-77e4aa94-0486-4cc4-b915-bfd696ce8221 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:37.620722 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-77e4aa94-0486-4cc4-b915-bfd696ce8221 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:37.756104 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-77e4aa94-0486-4cc4-b915-bfd696ce8221 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe37a6d57b4775b4e47a295c3f5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b2364f40d14160adf0220d92adaad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:37.764561 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-77e4aa94-0486-4cc4-b915-bfd696ce8221 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec" status: 200 len: 1367 microversion: 2.1 time: 0.158524 May 31 21:11:37.765069 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 399/832] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:11:37 2022] GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:11:37.820763 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [req-d45d3f3e-d9c4-42aa-b804-06945bc0d0d9 req-676a76c0-56cd-4778-9811-f550d77780f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92254a91-6b12-4811-a58e-e6f4cac9d965", "name": "network-vif-deleted", "tag": "184f337b-0888-4e33-981f-ff3bb1208077"}]} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:11:37.828749 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-d45d3f3e-d9c4-42aa-b804-06945bc0d0d9 req-676a76c0-56cd-4778-9811-f550d77780f4 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:37.832865 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-d45d3f3e-d9c4-42aa-b804-06945bc0d0d9 req-676a76c0-56cd-4778-9811-f550d77780f4 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:37.841450 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.compute.server_external_events [req-d45d3f3e-d9c4-42aa-b804-06945bc0d0d9 req-676a76c0-56cd-4778-9811-f550d77780f4 service nova] Creating event network-vif-deleted:184f337b-0888-4e33-981f-ff3bb1208077 for instance 92254a91-6b12-4811-a58e-e6f4cac9d965 on hv-cinder-83979 May 31 21:11:37.846450 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [req-d45d3f3e-d9c4-42aa-b804-06945bc0d0d9 req-676a76c0-56cd-4778-9811-f550d77780f4 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029365 May 31 21:11:37.847047 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 434/833] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:11:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:11:38.506292 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-569f21cf-ae8a-450f-bfbe-153c1fb6b63a tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:11:38.506949 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-569f21cf-ae8a-450f-bfbe-153c1fb6b63a tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 92254a91-6b12-4811-a58e-e6f4cac9d965] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:11:38.513953 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-569f21cf-ae8a-450f-bfbe-153c1fb6b63a tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:38.514664 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-569f21cf-ae8a-450f-bfbe-153c1fb6b63a tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:38.515569 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-569f21cf-ae8a-450f-bfbe-153c1fb6b63a tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:38.516107 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-569f21cf-ae8a-450f-bfbe-153c1fb6b63a tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:38.552419 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-569f21cf-ae8a-450f-bfbe-153c1fb6b63a tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:38.552870 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-569f21cf-ae8a-450f-bfbe-153c1fb6b63a tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:38.553322 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.objects.instance [None req-569f21cf-ae8a-450f-bfbe-153c1fb6b63a tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lazy-loading 'fault' on Instance uuid 92254a91-6b12-4811-a58e-e6f4cac9d965 {{(pid=118185) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 21:11:38.598736 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-569f21cf-ae8a-450f-bfbe-153c1fb6b63a tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:38.607400 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-569f21cf-ae8a-450f-bfbe-153c1fb6b63a tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965" status: 200 len: 1231 microversion: 2.1 time: 0.104478 May 31 21:11:38.607984 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 400/834] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:11:38 2022] GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965 => generated 1231 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:11:38.781555 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-e8eb3df8-5c83-4e8f-ba7e-a119ee4bd2f2 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:11:38.782359 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-e8eb3df8-5c83-4e8f-ba7e-a119ee4bd2f2 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 5cb669a7-8e63-46ac-86f6-1be4050a44ec] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:11:38.796845 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e8eb3df8-5c83-4e8f-ba7e-a119ee4bd2f2 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:38.796845 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e8eb3df8-5c83-4e8f-ba7e-a119ee4bd2f2 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:38.796845 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e8eb3df8-5c83-4e8f-ba7e-a119ee4bd2f2 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:38.796845 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e8eb3df8-5c83-4e8f-ba7e-a119ee4bd2f2 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:38.925274 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-e8eb3df8-5c83-4e8f-ba7e-a119ee4bd2f2 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe37a6d57b4775b4e47a295c3f5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b2364f40d14160adf0220d92adaad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:38.933395 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-e8eb3df8-5c83-4e8f-ba7e-a119ee4bd2f2 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec" status: 200 len: 1367 microversion: 2.1 time: 0.156625 May 31 21:11:38.933967 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 435/835] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:11:38 2022] GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:11:39.637186 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-aeb2a439-9eef-4515-8a88-723c83b8db69 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:11:39.637802 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-aeb2a439-9eef-4515-8a88-723c83b8db69 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 92254a91-6b12-4811-a58e-e6f4cac9d965] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:11:39.644388 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-aeb2a439-9eef-4515-8a88-723c83b8db69 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:39.644847 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-aeb2a439-9eef-4515-8a88-723c83b8db69 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:39.645624 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-aeb2a439-9eef-4515-8a88-723c83b8db69 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:39.646104 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-aeb2a439-9eef-4515-8a88-723c83b8db69 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:39.676215 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-aeb2a439-9eef-4515-8a88-723c83b8db69 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:39.676677 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-aeb2a439-9eef-4515-8a88-723c83b8db69 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:39.677122 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.objects.instance [None req-aeb2a439-9eef-4515-8a88-723c83b8db69 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lazy-loading 'fault' on Instance uuid 92254a91-6b12-4811-a58e-e6f4cac9d965 {{(pid=118185) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 21:11:39.721419 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-aeb2a439-9eef-4515-8a88-723c83b8db69 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:39.729529 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-aeb2a439-9eef-4515-8a88-723c83b8db69 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965" status: 200 len: 1231 microversion: 2.1 time: 0.096883 May 31 21:11:39.730134 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 401/836] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:11:39 2022] GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965 => generated 1231 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:11:39.950342 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-80967e11-b9ba-41c8-87cb-cdacaac04800 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:11:39.950953 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-80967e11-b9ba-41c8-87cb-cdacaac04800 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 5cb669a7-8e63-46ac-86f6-1be4050a44ec] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:11:39.957430 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-80967e11-b9ba-41c8-87cb-cdacaac04800 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:39.957887 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-80967e11-b9ba-41c8-87cb-cdacaac04800 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:39.958990 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-80967e11-b9ba-41c8-87cb-cdacaac04800 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:39.959431 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-80967e11-b9ba-41c8-87cb-cdacaac04800 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:40.085428 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-80967e11-b9ba-41c8-87cb-cdacaac04800 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe37a6d57b4775b4e47a295c3f5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b2364f40d14160adf0220d92adaad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:40.093451 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-80967e11-b9ba-41c8-87cb-cdacaac04800 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec" status: 200 len: 1557 microversion: 2.1 time: 0.147135 May 31 21:11:40.094048 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 436/837] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:11:39 2022] GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec => generated 1557 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:11:40.110239 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-f45a11ec-04d3-493c-84c1-b1bf587cb95c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:11:40.110820 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-f45a11ec-04d3-493c-84c1-b1bf587cb95c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 5cb669a7-8e63-46ac-86f6-1be4050a44ec] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:11:40.116760 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f45a11ec-04d3-493c-84c1-b1bf587cb95c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:40.117210 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f45a11ec-04d3-493c-84c1-b1bf587cb95c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:40.118032 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f45a11ec-04d3-493c-84c1-b1bf587cb95c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:40.118468 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f45a11ec-04d3-493c-84c1-b1bf587cb95c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:40.192623 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-f45a11ec-04d3-493c-84c1-b1bf587cb95c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.086329 May 31 21:11:40.193220 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 402/838] 10.222.0.55 () {58 vars in 1274 bytes} [Tue May 31 21:11:40 2022] GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec/os-interface => generated 285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:11:40.747506 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-1c2a91a1-1fdc-488c-8cc3-f1e4cc886521 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:11:40.748122 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-1c2a91a1-1fdc-488c-8cc3-f1e4cc886521 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 92254a91-6b12-4811-a58e-e6f4cac9d965] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:11:40.754666 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-1c2a91a1-1fdc-488c-8cc3-f1e4cc886521 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:40.755125 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-1c2a91a1-1fdc-488c-8cc3-f1e4cc886521 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:40.755912 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-1c2a91a1-1fdc-488c-8cc3-f1e4cc886521 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:40.756346 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-1c2a91a1-1fdc-488c-8cc3-f1e4cc886521 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:40.770979 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.wsgi [None req-1c2a91a1-1fdc-488c-8cc3-f1e4cc886521 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] HTTP exception thrown: Instance 92254a91-6b12-4811-a58e-e6f4cac9d965 could not be found. May 31 21:11:40.772709 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-1c2a91a1-1fdc-488c-8cc3-f1e4cc886521 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Request method failure captured: May 31 21:11:40.772709 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: request: GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965 HTTP/1.1 May 31 21:11:40.772709 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Accept: application/json May 31 21:11:40.772709 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Accept-Encoding: identity May 31 21:11:40.772709 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Connection: close May 31 21:11:40.772709 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Content-Length: 0 May 31 21:11:40.772709 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Content-Type: application/json May 31 21:11:40.772709 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Host: 10.222.0.55 May 31 21:11:40.772709 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Openstack-System-Scope: None May 31 21:11:40.772709 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: User-Agent: python-urllib3/1.26.9 May 31 21:11:40.772709 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Auth-Token: gAAAAABiloOgTfUO-lc7nDbKdfWKqO62bw1HfA7dgbwFJLheVHCZ2y6EF_fvHD4X3sHUmdUzsBqmSOFIsvCVJUmPvIr-lVLeVzFeCCM4eyesBpMRiqru6yEXb3xLsTUiiV10djblIsjlqlgif1nnW_lIm6b4EE-6k61w7JcDt3BQ6dUVTmkqiv8 May 31 21:11:40.772709 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Domain-Id: None May 31 21:11:40.772709 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Domain-Name: None May 31 21:11:40.772709 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Identity-Status: Confirmed May 31 21:11:40.772709 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Is-Admin-Project: True May 31 21:11:40.772709 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Domain-Id: default May 31 21:11:40.772709 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Domain-Name: Default May 31 21:11:40.772709 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Id: 8e511490c0f8438fb89ac590bd63529f May 31 21:11:40.772709 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Name: tempest-TestVolumeBootPattern-1802532727 May 31 21:11:40.772709 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Role: member,reader May 31 21:11:40.772709 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Roles: member,reader May 31 21:11:40.774279 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/8e511490c0f8438fb89ac590bd63529f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/8e511490c0f8438fb89ac590bd63529f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_8e511490c0f8438fb89ac590bd63529f", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/8e511490c0f8438fb89ac590bd63529f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] May 31 21:11:40.774279 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant: tempest-TestVolumeBootPattern-1802532727 May 31 21:11:40.774279 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant-Id: 8e511490c0f8438fb89ac590bd63529f May 31 21:11:40.774279 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant-Name: tempest-TestVolumeBootPattern-1802532727 May 31 21:11:40.774279 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User: tempest-TestVolumeBootPattern-1802532727-project May 31 21:11:40.774279 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Domain-Id: default May 31 21:11:40.774279 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Domain-Name: Default May 31 21:11:40.774279 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Id: 546cd066c4244bffacbfea21f5e4f437 May 31 21:11:40.774279 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Name: tempest-TestVolumeBootPattern-1802532727-project May 31 21:11:40.774279 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: method: > May 31 21:11:40.774279 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: exception: Instance 92254a91-6b12-4811-a58e-e6f4cac9d965 could not be found. May 31 21:11:40.774279 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: action_args: {'id': '92254a91-6b12-4811-a58e-e6f4cac9d965'} May 31 21:11:40.775136 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 21:11:40.775136 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:11:40.775136 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 21:11:40.775136 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 21:11:40.775136 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 21:11:40.775136 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 21:11:40.775136 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 21:11:40.775136 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 21:11:40.775136 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 21:11:40.775136 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 21:11:40.775136 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92254a91-6b12-4811-a58e-e6f4cac9d965 could not be found. May 31 21:11:40.775136 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:11:40.775136 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:11:40.775136 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:11:40.775136 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:11:40.775136 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:11:40.775136 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:11:40.775136 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 21:11:40.775136 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 21:11:40.775136 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 21:11:40.776588 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 21:11:40.776588 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 21:11:40.776588 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 21:11:40.776588 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 21:11:40.776588 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 21:11:40.776588 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 21:11:40.776588 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 21:11:40.776588 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92254a91-6b12-4811-a58e-e6f4cac9d965 could not be found. May 31 21:11:40.776588 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:11:40.776588 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:11:40.776588 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:11:40.776588 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:11:40.776588 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:11:40.776588 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:11:40.776588 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 21:11:40.776588 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 21:11:40.776588 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92254a91-6b12-4811-a58e-e6f4cac9d965 could not be found. May 31 21:11:40.776588 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:11:40.778214 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-1c2a91a1-1fdc-488c-8cc3-f1e4cc886521 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Returning 404 to user: Instance 92254a91-6b12-4811-a58e-e6f4cac9d965 could not be found. {{(pid=118184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 21:11:40.778214 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-1c2a91a1-1fdc-488c-8cc3-f1e4cc886521 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965" status: 404 len: 111 microversion: 2.1 time: 0.031209 May 31 21:11:40.778214 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 437/839] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:11:40 2022] GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 21:11:40.877551 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-811d757c-52a0-4924-b7ab-8f03baff6ae2 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1816869767", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1276431592", "security_groups": [{"name": "tempest-secgroup-smoke-506263611"}], "block_device_mapping_v2": [{"uuid": "62bbc2be-5003-454f-9e2a-cc350298eb61", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2c2f81e7-9a7d-4701-bf43-a528a17f585a"}]}} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:11:40.988112 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.network.neutron [None req-811d757c-52a0-4924-b7ab-8f03baff6ae2 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] validate_networks() for [('2c2f81e7-9a7d-4701-bf43-a528a17f585a', None, None, None, None, None)] {{(pid=118185) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 21:11:41.676381 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.virt.hardware [None req-811d757c-52a0-4924-b7ab-8f03baff6ae2 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Flavor limits 0:0:0 {{(pid=118185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 21:11:41.676963 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.virt.hardware [None req-811d757c-52a0-4924-b7ab-8f03baff6ae2 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Image limits 0:0:0 {{(pid=118185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 21:11:41.677441 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.virt.hardware [None req-811d757c-52a0-4924-b7ab-8f03baff6ae2 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Flavor pref 0:0:0 {{(pid=118185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 21:11:41.678125 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.virt.hardware [None req-811d757c-52a0-4924-b7ab-8f03baff6ae2 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Image pref 0:0:0 {{(pid=118185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 21:11:41.678573 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.virt.hardware [None req-811d757c-52a0-4924-b7ab-8f03baff6ae2 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 21:11:41.690434 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-811d757c-52a0-4924-b7ab-8f03baff6ae2 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:41.690434 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-811d757c-52a0-4924-b7ab-8f03baff6ae2 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:41.690434 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-811d757c-52a0-4924-b7ab-8f03baff6ae2 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:41.691142 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-811d757c-52a0-4924-b7ab-8f03baff6ae2 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:41.709642 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.quota [None req-811d757c-52a0-4924-b7ab-8f03baff6ae2 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Getting quotas for project 8e511490c0f8438fb89ac590bd63529f. Resources: {'ram', 'cores', 'instances'} {{(pid=118185) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 21:11:41.713933 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.quota [None req-811d757c-52a0-4924-b7ab-8f03baff6ae2 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Getting quotas for user 546cd066c4244bffacbfea21f5e4f437 and project 8e511490c0f8438fb89ac590bd63529f. Resources: {'ram', 'cores', 'instances'} {{(pid=118185) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 21:11:41.734430 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [req-f62eab90-484c-4c03-8703-dfdb58a5707c req-34422cf7-4db5-4e3b-bcb9-4b121210b30f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cb669a7-8e63-46ac-86f6-1be4050a44ec", "tag": "e802cc62-ebe6-41ff-a0a9-e0f9038c9831"}]} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:11:41.744937 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-f62eab90-484c-4c03-8703-dfdb58a5707c req-34422cf7-4db5-4e3b-bcb9-4b121210b30f service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:41.745753 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-f62eab90-484c-4c03-8703-dfdb58a5707c req-34422cf7-4db5-4e3b-bcb9-4b121210b30f service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:41.759512 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.compute.server_external_events [req-f62eab90-484c-4c03-8703-dfdb58a5707c req-34422cf7-4db5-4e3b-bcb9-4b121210b30f service nova] Creating event network-changed:e802cc62-ebe6-41ff-a0a9-e0f9038c9831 for instance 5cb669a7-8e63-46ac-86f6-1be4050a44ec on hv-cinder-83979 May 31 21:11:41.766027 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [req-f62eab90-484c-4c03-8703-dfdb58a5707c req-34422cf7-4db5-4e3b-bcb9-4b121210b30f service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035325 May 31 21:11:41.767019 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 438/840] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:11:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 21:11:41.773875 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-811d757c-52a0-4924-b7ab-8f03baff6ae2 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Going to run 1 instances... {{(pid=118185) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 21:11:41.776209 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-811d757c-52a0-4924-b7ab-8f03baff6ae2 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 48d80d94-ed1f-4792-955f-5ac166350cb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='62bbc2be-5003-454f-9e2a-cc350298eb61',volume_size=None,volume_type=None)] {{(pid=118185) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 21:11:42.435427 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-811d757c-52a0-4924-b7ab-8f03baff6ae2 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.562252 May 31 21:11:42.436397 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 403/841] 10.222.0.55 () {60 vars in 1146 bytes} [Tue May 31 21:11:40 2022] POST /compute/v2.1/servers => generated 405 bytes in 1564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 31 21:11:42.447164 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-cec365d3-dd95-4304-8cf6-62cc765e3691 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:11:42.451147 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-cec365d3-dd95-4304-8cf6-62cc765e3691 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 48d80d94-ed1f-4792-955f-5ac166350cb8] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:11:42.514633 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-cec365d3-dd95-4304-8cf6-62cc765e3691 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:42.523225 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-cec365d3-dd95-4304-8cf6-62cc765e3691 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/48d80d94-ed1f-4792-955f-5ac166350cb8" status: 200 len: 1095 microversion: 2.1 time: 0.080360 May 31 21:11:42.524350 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 439/842] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:11:42 2022] GET /compute/v2.1/servers/48d80d94-ed1f-4792-955f-5ac166350cb8 => generated 1095 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:11:43.541815 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-b6627c2c-43a2-442f-be7a-a4914d4ee167 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:11:43.542405 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-b6627c2c-43a2-442f-be7a-a4914d4ee167 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 48d80d94-ed1f-4792-955f-5ac166350cb8] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:11:43.548521 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b6627c2c-43a2-442f-be7a-a4914d4ee167 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:43.548978 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b6627c2c-43a2-442f-be7a-a4914d4ee167 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:43.549752 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b6627c2c-43a2-442f-be7a-a4914d4ee167 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:43.550218 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b6627c2c-43a2-442f-be7a-a4914d4ee167 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:43.613618 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-b6627c2c-43a2-442f-be7a-a4914d4ee167 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:43.621744 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-b6627c2c-43a2-442f-be7a-a4914d4ee167 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/48d80d94-ed1f-4792-955f-5ac166350cb8" status: 200 len: 1137 microversion: 2.1 time: 0.084997 May 31 21:11:43.622343 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 404/843] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:11:43 2022] GET /compute/v2.1/servers/48d80d94-ed1f-4792-955f-5ac166350cb8 => generated 1137 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:11:44.639064 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-2bf63462-f067-4fe1-bc84-ca17da29749e tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:11:44.639725 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-2bf63462-f067-4fe1-bc84-ca17da29749e tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 48d80d94-ed1f-4792-955f-5ac166350cb8] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:11:44.646880 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2bf63462-f067-4fe1-bc84-ca17da29749e tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:44.654903 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2bf63462-f067-4fe1-bc84-ca17da29749e tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:44.654903 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2bf63462-f067-4fe1-bc84-ca17da29749e tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:44.654903 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2bf63462-f067-4fe1-bc84-ca17da29749e tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:44.713030 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-2bf63462-f067-4fe1-bc84-ca17da29749e tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:44.719210 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-2bf63462-f067-4fe1-bc84-ca17da29749e tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/48d80d94-ed1f-4792-955f-5ac166350cb8" status: 200 len: 1211 microversion: 2.1 time: 0.084165 May 31 21:11:44.719783 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 440/844] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:11:44 2022] GET /compute/v2.1/servers/48d80d94-ed1f-4792-955f-5ac166350cb8 => generated 1211 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:11:45.738341 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-4b3f5d1c-dd11-43be-978e-44d19ba6728b tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:11:45.738341 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-4b3f5d1c-dd11-43be-978e-44d19ba6728b tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 48d80d94-ed1f-4792-955f-5ac166350cb8] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:11:45.745402 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4b3f5d1c-dd11-43be-978e-44d19ba6728b tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:45.745857 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4b3f5d1c-dd11-43be-978e-44d19ba6728b tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:45.746745 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4b3f5d1c-dd11-43be-978e-44d19ba6728b tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:45.747140 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4b3f5d1c-dd11-43be-978e-44d19ba6728b tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:45.910908 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-4b3f5d1c-dd11-43be-978e-44d19ba6728b tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:45.921105 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-4b3f5d1c-dd11-43be-978e-44d19ba6728b tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/48d80d94-ed1f-4792-955f-5ac166350cb8" status: 200 len: 1266 microversion: 2.1 time: 0.187836 May 31 21:11:45.932374 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 405/845] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:11:45 2022] GET /compute/v2.1/servers/48d80d94-ed1f-4792-955f-5ac166350cb8 => generated 1266 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:11:46.131202 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [req-21c311ce-3db3-4502-976c-26d296d66d2e req-8d1c5de2-d550-4739-a27d-1ba0422743b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48d80d94-ed1f-4792-955f-5ac166350cb8", "tag": "be6188bf-51f6-4051-bc2f-677f9aefbc61"}]} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:11:46.140220 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-21c311ce-3db3-4502-976c-26d296d66d2e req-8d1c5de2-d550-4739-a27d-1ba0422743b4 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:46.140764 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-21c311ce-3db3-4502-976c-26d296d66d2e req-8d1c5de2-d550-4739-a27d-1ba0422743b4 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:46.154562 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.compute.server_external_events [req-21c311ce-3db3-4502-976c-26d296d66d2e req-8d1c5de2-d550-4739-a27d-1ba0422743b4 service nova] Creating event network-changed:be6188bf-51f6-4051-bc2f-677f9aefbc61 for instance 48d80d94-ed1f-4792-955f-5ac166350cb8 on hv-cinder-83979 May 31 21:11:46.160189 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [req-21c311ce-3db3-4502-976c-26d296d66d2e req-8d1c5de2-d550-4739-a27d-1ba0422743b4 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033075 May 31 21:11:46.160908 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 441/846] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:11:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:11:46.939287 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-3f7dd007-0d9e-485e-90b2-521db5240e67 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:11:46.939929 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-3f7dd007-0d9e-485e-90b2-521db5240e67 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 48d80d94-ed1f-4792-955f-5ac166350cb8] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:11:46.947370 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-3f7dd007-0d9e-485e-90b2-521db5240e67 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:46.947876 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-3f7dd007-0d9e-485e-90b2-521db5240e67 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:46.949239 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-3f7dd007-0d9e-485e-90b2-521db5240e67 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:46.949741 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-3f7dd007-0d9e-485e-90b2-521db5240e67 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:47.089456 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-3f7dd007-0d9e-485e-90b2-521db5240e67 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:47.097041 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-3f7dd007-0d9e-485e-90b2-521db5240e67 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/48d80d94-ed1f-4792-955f-5ac166350cb8" status: 200 len: 1266 microversion: 2.1 time: 0.161670 May 31 21:11:47.097602 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 406/847] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:11:46 2022] GET /compute/v2.1/servers/48d80d94-ed1f-4792-955f-5ac166350cb8 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:11:48.114593 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-e8ca07a3-7c43-4b61-b511-597cbfab7fc7 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:11:48.115201 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-e8ca07a3-7c43-4b61-b511-597cbfab7fc7 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 48d80d94-ed1f-4792-955f-5ac166350cb8] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:11:48.122016 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e8ca07a3-7c43-4b61-b511-597cbfab7fc7 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:48.122461 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e8ca07a3-7c43-4b61-b511-597cbfab7fc7 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:48.123224 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e8ca07a3-7c43-4b61-b511-597cbfab7fc7 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:48.123713 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e8ca07a3-7c43-4b61-b511-597cbfab7fc7 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:48.257373 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-e8ca07a3-7c43-4b61-b511-597cbfab7fc7 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:48.265432 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-e8ca07a3-7c43-4b61-b511-597cbfab7fc7 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/48d80d94-ed1f-4792-955f-5ac166350cb8" status: 200 len: 1266 microversion: 2.1 time: 0.155197 May 31 21:11:48.266009 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 442/848] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:11:48 2022] GET /compute/v2.1/servers/48d80d94-ed1f-4792-955f-5ac166350cb8 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:11:49.282617 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-3057df68-5801-4b6d-956d-c9693b126524 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:11:49.283226 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-3057df68-5801-4b6d-956d-c9693b126524 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 48d80d94-ed1f-4792-955f-5ac166350cb8] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:11:49.289325 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-3057df68-5801-4b6d-956d-c9693b126524 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:49.289771 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-3057df68-5801-4b6d-956d-c9693b126524 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:49.290564 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-3057df68-5801-4b6d-956d-c9693b126524 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:49.291024 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-3057df68-5801-4b6d-956d-c9693b126524 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:49.419714 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-3057df68-5801-4b6d-956d-c9693b126524 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:49.427426 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-3057df68-5801-4b6d-956d-c9693b126524 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/48d80d94-ed1f-4792-955f-5ac166350cb8" status: 200 len: 1266 microversion: 2.1 time: 0.148659 May 31 21:11:49.427983 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 407/849] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:11:49 2022] GET /compute/v2.1/servers/48d80d94-ed1f-4792-955f-5ac166350cb8 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:11:50.111595 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-5a26c88f-19ed-4fd8-b5cf-3e63468a244a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:11:50.112128 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-5a26c88f-19ed-4fd8-b5cf-3e63468a244a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:11:50.118592 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5a26c88f-19ed-4fd8-b5cf-3e63468a244a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:50.119044 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5a26c88f-19ed-4fd8-b5cf-3e63468a244a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:50.119805 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5a26c88f-19ed-4fd8-b5cf-3e63468a244a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:50.120750 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5a26c88f-19ed-4fd8-b5cf-3e63468a244a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:50.144426 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-5a26c88f-19ed-4fd8-b5cf-3e63468a244a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4/ips" status: 200 len: 151 microversion: 2.20 time: 0.036778 May 31 21:11:50.145001 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 443/850] 10.222.0.55 () {60 vars in 1288 bytes} [Tue May 31 21:11:50 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 21:11:50.444081 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-54673e75-e616-4923-9587-ceb7ccfcae0c tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:11:50.444714 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-54673e75-e616-4923-9587-ceb7ccfcae0c tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 48d80d94-ed1f-4792-955f-5ac166350cb8] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:11:50.451406 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-54673e75-e616-4923-9587-ceb7ccfcae0c tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:50.451859 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-54673e75-e616-4923-9587-ceb7ccfcae0c tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:50.452621 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-54673e75-e616-4923-9587-ceb7ccfcae0c tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:50.453058 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-54673e75-e616-4923-9587-ceb7ccfcae0c tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:50.584674 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-54673e75-e616-4923-9587-ceb7ccfcae0c tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:50.592786 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-54673e75-e616-4923-9587-ceb7ccfcae0c tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/48d80d94-ed1f-4792-955f-5ac166350cb8" status: 200 len: 1266 microversion: 2.1 time: 0.152594 May 31 21:11:50.593352 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 408/851] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:11:50 2022] GET /compute/v2.1/servers/48d80d94-ed1f-4792-955f-5ac166350cb8 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:11:51.608930 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-7520f909-83e9-45a2-b649-abc55e5aaca5 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:11:51.609578 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-7520f909-83e9-45a2-b649-abc55e5aaca5 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 48d80d94-ed1f-4792-955f-5ac166350cb8] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:11:51.616190 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7520f909-83e9-45a2-b649-abc55e5aaca5 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:51.616640 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7520f909-83e9-45a2-b649-abc55e5aaca5 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:51.617406 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7520f909-83e9-45a2-b649-abc55e5aaca5 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:51.617843 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7520f909-83e9-45a2-b649-abc55e5aaca5 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:51.759191 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-7520f909-83e9-45a2-b649-abc55e5aaca5 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:51.761423 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-7520f909-83e9-45a2-b649-abc55e5aaca5 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/48d80d94-ed1f-4792-955f-5ac166350cb8" status: 200 len: 1266 microversion: 2.1 time: 0.156421 May 31 21:11:51.762006 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 444/852] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:11:51 2022] GET /compute/v2.1/servers/48d80d94-ed1f-4792-955f-5ac166350cb8 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:11:52.409022 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-bb11e55b-5a7f-4ef2-9f5c-e9851ede8281 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:11:52.409591 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-bb11e55b-5a7f-4ef2-9f5c-e9851ede8281 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:11:52.413793 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell0:SELECT=2 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:11:52.413793 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell0:SELECT=6 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:11:52.418131 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-bb11e55b-5a7f-4ef2-9f5c-e9851ede8281 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:52.418586 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-bb11e55b-5a7f-4ef2-9f5c-e9851ede8281 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:52.419351 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-bb11e55b-5a7f-4ef2-9f5c-e9851ede8281 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:52.419790 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-bb11e55b-5a7f-4ef2-9f5c-e9851ede8281 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:52.441776 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.objects.instance [None req-bb11e55b-5a7f-4ef2-9f5c-e9851ede8281 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lazy-loading 'flavor' on Instance uuid 1d316a51-73db-479f-8449-ab51b42548e4 {{(pid=118185) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 21:11:52.496762 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:11:52.778662 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-376ffb9e-0fe9-42e7-b874-4706ef810799 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:11:52.779320 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-376ffb9e-0fe9-42e7-b874-4706ef810799 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 48d80d94-ed1f-4792-955f-5ac166350cb8] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:11:52.781245 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell0:SELECT=2 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:11:52.787117 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-376ffb9e-0fe9-42e7-b874-4706ef810799 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:52.789117 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-376ffb9e-0fe9-42e7-b874-4706ef810799 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:52.790518 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-376ffb9e-0fe9-42e7-b874-4706ef810799 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:52.791326 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-376ffb9e-0fe9-42e7-b874-4706ef810799 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:52.925149 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-376ffb9e-0fe9-42e7-b874-4706ef810799 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:52.933465 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-376ffb9e-0fe9-42e7-b874-4706ef810799 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/48d80d94-ed1f-4792-955f-5ac166350cb8" status: 200 len: 1266 microversion: 2.1 time: 0.159302 May 31 21:11:52.942578 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 445/853] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:11:52 2022] GET /compute/v2.1/servers/48d80d94-ed1f-4792-955f-5ac166350cb8 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:11:53.062539 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-bb11e55b-5a7f-4ef2-9f5c-e9851ede8281 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "POST /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4/action" status: 202 len: 0 microversion: 2.20 time: 0.657157 May 31 21:11:53.063637 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 409/854] 10.222.0.55 () {62 vars in 1318 bytes} [Tue May 31 21:11:52 2022] POST /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4/action => generated 0 bytes in 659 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 31 21:11:53.078611 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-24228045-1219-4eea-bf16-790b6c5e766f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:11:53.079217 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-24228045-1219-4eea-bf16-790b6c5e766f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:11:53.085700 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-24228045-1219-4eea-bf16-790b6c5e766f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:53.086218 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-24228045-1219-4eea-bf16-790b6c5e766f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:53.087025 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-24228045-1219-4eea-bf16-790b6c5e766f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:53.087463 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-24228045-1219-4eea-bf16-790b6c5e766f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:53.225592 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-24228045-1219-4eea-bf16-790b6c5e766f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:53.234302 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-24228045-1219-4eea-bf16-790b6c5e766f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:53.235832 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-24228045-1219-4eea-bf16-790b6c5e766f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:53.237161 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-24228045-1219-4eea-bf16-790b6c5e766f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1719 microversion: 2.20 time: 0.162243 May 31 21:11:53.237587 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 446/855] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:11:53 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1719 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:11:53.951296 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-efe58256-d160-439e-a11f-258b4b8cea44 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:11:53.951941 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-efe58256-d160-439e-a11f-258b4b8cea44 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 48d80d94-ed1f-4792-955f-5ac166350cb8] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:11:53.958614 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-efe58256-d160-439e-a11f-258b4b8cea44 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:53.959064 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-efe58256-d160-439e-a11f-258b4b8cea44 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:53.959831 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-efe58256-d160-439e-a11f-258b4b8cea44 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:53.960271 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-efe58256-d160-439e-a11f-258b4b8cea44 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:54.092454 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-efe58256-d160-439e-a11f-258b4b8cea44 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:54.100098 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-efe58256-d160-439e-a11f-258b4b8cea44 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/48d80d94-ed1f-4792-955f-5ac166350cb8" status: 200 len: 1266 microversion: 2.1 time: 0.154243 May 31 21:11:54.100740 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 410/856] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:11:53 2022] GET /compute/v2.1/servers/48d80d94-ed1f-4792-955f-5ac166350cb8 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:11:54.256511 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-419ff3e5-5b23-4a7d-9685-2eac8074fa48 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:11:54.257044 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-419ff3e5-5b23-4a7d-9685-2eac8074fa48 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:11:54.264191 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-419ff3e5-5b23-4a7d-9685-2eac8074fa48 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:54.264636 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-419ff3e5-5b23-4a7d-9685-2eac8074fa48 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:54.265388 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-419ff3e5-5b23-4a7d-9685-2eac8074fa48 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:54.265820 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-419ff3e5-5b23-4a7d-9685-2eac8074fa48 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:54.392611 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-419ff3e5-5b23-4a7d-9685-2eac8074fa48 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:54.400618 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-419ff3e5-5b23-4a7d-9685-2eac8074fa48 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:54.402161 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-419ff3e5-5b23-4a7d-9685-2eac8074fa48 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:54.403325 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-419ff3e5-5b23-4a7d-9685-2eac8074fa48 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1719 microversion: 2.20 time: 0.150841 May 31 21:11:54.403886 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 447/857] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:11:54 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1719 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:11:55.116914 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-401b406b-1f4b-4803-8573-4b51ada5dc4d tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:11:55.117494 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-401b406b-1f4b-4803-8573-4b51ada5dc4d tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 48d80d94-ed1f-4792-955f-5ac166350cb8] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:11:55.123923 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-401b406b-1f4b-4803-8573-4b51ada5dc4d tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:55.127245 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-401b406b-1f4b-4803-8573-4b51ada5dc4d tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:55.127245 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-401b406b-1f4b-4803-8573-4b51ada5dc4d tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:55.127245 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-401b406b-1f4b-4803-8573-4b51ada5dc4d tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:55.259420 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-401b406b-1f4b-4803-8573-4b51ada5dc4d tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:55.266898 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-401b406b-1f4b-4803-8573-4b51ada5dc4d tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/48d80d94-ed1f-4792-955f-5ac166350cb8" status: 200 len: 1266 microversion: 2.1 time: 0.154064 May 31 21:11:55.267485 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 411/858] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:11:55 2022] GET /compute/v2.1/servers/48d80d94-ed1f-4792-955f-5ac166350cb8 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:11:55.422097 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-5deba21c-874d-473e-953f-69133099a5c8 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:11:55.422635 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-5deba21c-874d-473e-953f-69133099a5c8 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:11:55.429039 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5deba21c-874d-473e-953f-69133099a5c8 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:55.429484 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5deba21c-874d-473e-953f-69133099a5c8 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:55.430262 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5deba21c-874d-473e-953f-69133099a5c8 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:55.430692 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5deba21c-874d-473e-953f-69133099a5c8 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:55.557624 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-5deba21c-874d-473e-953f-69133099a5c8 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:55.564437 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-5deba21c-874d-473e-953f-69133099a5c8 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:55.565933 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-5deba21c-874d-473e-953f-69133099a5c8 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:55.567076 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-5deba21c-874d-473e-953f-69133099a5c8 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1719 microversion: 2.20 time: 0.149063 May 31 21:11:55.567676 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 448/859] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:11:55 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1719 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:11:56.283686 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-9647b9a0-4a9b-4f03-abe1-e04ca2e8a5e0 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:11:56.284308 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-9647b9a0-4a9b-4f03-abe1-e04ca2e8a5e0 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 48d80d94-ed1f-4792-955f-5ac166350cb8] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:11:56.286962 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:11:56.291842 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9647b9a0-4a9b-4f03-abe1-e04ca2e8a5e0 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:56.292311 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9647b9a0-4a9b-4f03-abe1-e04ca2e8a5e0 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:56.293090 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9647b9a0-4a9b-4f03-abe1-e04ca2e8a5e0 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:56.293527 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9647b9a0-4a9b-4f03-abe1-e04ca2e8a5e0 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:56.430064 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-9647b9a0-4a9b-4f03-abe1-e04ca2e8a5e0 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:56.437835 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-9647b9a0-4a9b-4f03-abe1-e04ca2e8a5e0 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/48d80d94-ed1f-4792-955f-5ac166350cb8" status: 200 len: 1266 microversion: 2.1 time: 0.158193 May 31 21:11:56.440810 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 412/860] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:11:56 2022] GET /compute/v2.1/servers/48d80d94-ed1f-4792-955f-5ac166350cb8 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:11:56.586268 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-9e382532-ac4e-4963-966d-bdab9fa1f35a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:11:56.586821 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-9e382532-ac4e-4963-966d-bdab9fa1f35a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:11:56.589111 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:11:56.594219 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-9e382532-ac4e-4963-966d-bdab9fa1f35a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:56.594695 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-9e382532-ac4e-4963-966d-bdab9fa1f35a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:56.595487 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-9e382532-ac4e-4963-966d-bdab9fa1f35a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:56.595945 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-9e382532-ac4e-4963-966d-bdab9fa1f35a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:56.728022 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-9e382532-ac4e-4963-966d-bdab9fa1f35a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:56.736260 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-9e382532-ac4e-4963-966d-bdab9fa1f35a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:56.737759 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-9e382532-ac4e-4963-966d-bdab9fa1f35a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:56.738951 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-9e382532-ac4e-4963-966d-bdab9fa1f35a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1719 microversion: 2.20 time: 0.157042 May 31 21:11:56.739510 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 449/861] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:11:56 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1719 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:11:57.454668 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-ebd3b002-4470-4859-9f88-c3dac79a5beb tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:11:57.455273 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-ebd3b002-4470-4859-9f88-c3dac79a5beb tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 48d80d94-ed1f-4792-955f-5ac166350cb8] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:11:57.461950 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ebd3b002-4470-4859-9f88-c3dac79a5beb tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:57.462406 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ebd3b002-4470-4859-9f88-c3dac79a5beb tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:57.463180 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ebd3b002-4470-4859-9f88-c3dac79a5beb tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:57.463626 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ebd3b002-4470-4859-9f88-c3dac79a5beb tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:57.601265 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-ebd3b002-4470-4859-9f88-c3dac79a5beb tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:57.609694 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-ebd3b002-4470-4859-9f88-c3dac79a5beb tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/48d80d94-ed1f-4792-955f-5ac166350cb8" status: 200 len: 1266 microversion: 2.1 time: 0.158941 May 31 21:11:57.610285 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 413/862] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:11:57 2022] GET /compute/v2.1/servers/48d80d94-ed1f-4792-955f-5ac166350cb8 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:11:57.757672 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-af34cb1c-36f1-4fbc-878d-c3a9b13f6cdb tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:11:57.758307 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-af34cb1c-36f1-4fbc-878d-c3a9b13f6cdb tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:11:57.765356 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-af34cb1c-36f1-4fbc-878d-c3a9b13f6cdb tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:57.765811 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-af34cb1c-36f1-4fbc-878d-c3a9b13f6cdb tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:57.766600 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-af34cb1c-36f1-4fbc-878d-c3a9b13f6cdb tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:57.767038 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-af34cb1c-36f1-4fbc-878d-c3a9b13f6cdb tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:57.771011 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:11:57.895519 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-af34cb1c-36f1-4fbc-878d-c3a9b13f6cdb tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:57.904433 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-af34cb1c-36f1-4fbc-878d-c3a9b13f6cdb tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:57.905962 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-af34cb1c-36f1-4fbc-878d-c3a9b13f6cdb tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:57.907124 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-af34cb1c-36f1-4fbc-878d-c3a9b13f6cdb tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1719 microversion: 2.20 time: 0.153364 May 31 21:11:57.907692 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 450/863] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:11:57 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1719 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:11:58.626926 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-57039ff3-e41d-4c88-ba88-2466b0d1a8a4 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:11:58.627518 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-57039ff3-e41d-4c88-ba88-2466b0d1a8a4 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 48d80d94-ed1f-4792-955f-5ac166350cb8] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:11:58.634009 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-57039ff3-e41d-4c88-ba88-2466b0d1a8a4 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:58.634457 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-57039ff3-e41d-4c88-ba88-2466b0d1a8a4 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:58.635221 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-57039ff3-e41d-4c88-ba88-2466b0d1a8a4 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:58.635655 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-57039ff3-e41d-4c88-ba88-2466b0d1a8a4 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:58.764619 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-57039ff3-e41d-4c88-ba88-2466b0d1a8a4 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:58.772475 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-57039ff3-e41d-4c88-ba88-2466b0d1a8a4 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/48d80d94-ed1f-4792-955f-5ac166350cb8" status: 200 len: 1266 microversion: 2.1 time: 0.149294 May 31 21:11:58.773068 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 414/864] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:11:58 2022] GET /compute/v2.1/servers/48d80d94-ed1f-4792-955f-5ac166350cb8 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:11:58.924779 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-532bd94b-4fef-4f48-bb30-00edea1c504e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:11:58.925445 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-532bd94b-4fef-4f48-bb30-00edea1c504e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:11:58.932131 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-532bd94b-4fef-4f48-bb30-00edea1c504e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:58.932591 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-532bd94b-4fef-4f48-bb30-00edea1c504e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:58.933534 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-532bd94b-4fef-4f48-bb30-00edea1c504e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:58.934540 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-532bd94b-4fef-4f48-bb30-00edea1c504e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:58.936728 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [req-fcef24b5-794f-4726-b33a-8be482e55862 req-4bad2c17-7915-4990-bca4-8ee7ff82d35b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48d80d94-ed1f-4792-955f-5ac166350cb8", "name": "network-vif-plugged", "status": "completed", "tag": "be6188bf-51f6-4051-bc2f-677f9aefbc61"}]} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:11:58.945331 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-fcef24b5-794f-4726-b33a-8be482e55862 req-4bad2c17-7915-4990-bca4-8ee7ff82d35b service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:58.950608 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-fcef24b5-794f-4726-b33a-8be482e55862 req-4bad2c17-7915-4990-bca4-8ee7ff82d35b service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:58.957636 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.compute.server_external_events [req-fcef24b5-794f-4726-b33a-8be482e55862 req-4bad2c17-7915-4990-bca4-8ee7ff82d35b service nova] Creating event network-vif-plugged:be6188bf-51f6-4051-bc2f-677f9aefbc61 for instance 48d80d94-ed1f-4792-955f-5ac166350cb8 on hv-cinder-83979 May 31 21:11:58.963091 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [req-fcef24b5-794f-4726-b33a-8be482e55862 req-4bad2c17-7915-4990-bca4-8ee7ff82d35b service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030635 May 31 21:11:58.963947 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 415/865] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:11:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 21:11:59.082321 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-532bd94b-4fef-4f48-bb30-00edea1c504e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:59.090616 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-532bd94b-4fef-4f48-bb30-00edea1c504e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:59.092127 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-532bd94b-4fef-4f48-bb30-00edea1c504e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:59.093280 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-532bd94b-4fef-4f48-bb30-00edea1c504e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1719 microversion: 2.20 time: 0.172615 May 31 21:11:59.093969 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 451/866] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:11:58 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1719 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:11:59.791357 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-c78333b9-50d4-4ef7-b4fb-e8f318252dc5 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:11:59.791984 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-c78333b9-50d4-4ef7-b4fb-e8f318252dc5 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 48d80d94-ed1f-4792-955f-5ac166350cb8] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:11:59.799105 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c78333b9-50d4-4ef7-b4fb-e8f318252dc5 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:59.799554 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c78333b9-50d4-4ef7-b4fb-e8f318252dc5 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:59.800385 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c78333b9-50d4-4ef7-b4fb-e8f318252dc5 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:11:59.800820 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c78333b9-50d4-4ef7-b4fb-e8f318252dc5 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:11:59.931144 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-c78333b9-50d4-4ef7-b4fb-e8f318252dc5 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:11:59.938514 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-c78333b9-50d4-4ef7-b4fb-e8f318252dc5 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/48d80d94-ed1f-4792-955f-5ac166350cb8" status: 200 len: 1266 microversion: 2.1 time: 0.151963 May 31 21:11:59.939073 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 416/867] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:11:59 2022] GET /compute/v2.1/servers/48d80d94-ed1f-4792-955f-5ac166350cb8 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:12:00.111690 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-a6c61057-d1fc-4d14-a507-3f3c89c21f04 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:12:00.112230 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-a6c61057-d1fc-4d14-a507-3f3c89c21f04 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:12:00.118636 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a6c61057-d1fc-4d14-a507-3f3c89c21f04 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:00.119077 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a6c61057-d1fc-4d14-a507-3f3c89c21f04 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:00.119858 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a6c61057-d1fc-4d14-a507-3f3c89c21f04 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:00.120289 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a6c61057-d1fc-4d14-a507-3f3c89c21f04 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:00.249196 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-a6c61057-d1fc-4d14-a507-3f3c89c21f04 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:00.257110 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-a6c61057-d1fc-4d14-a507-3f3c89c21f04 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:00.258637 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-a6c61057-d1fc-4d14-a507-3f3c89c21f04 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:00.259779 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-a6c61057-d1fc-4d14-a507-3f3c89c21f04 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1719 microversion: 2.20 time: 0.152174 May 31 21:12:00.260344 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 452/868] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:12:00 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1719 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:12:00.955234 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-74109e72-361c-41fc-ad16-54da7b268812 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:12:00.955790 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-74109e72-361c-41fc-ad16-54da7b268812 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 48d80d94-ed1f-4792-955f-5ac166350cb8] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:12:00.962668 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-74109e72-361c-41fc-ad16-54da7b268812 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:00.963237 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-74109e72-361c-41fc-ad16-54da7b268812 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:00.964009 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-74109e72-361c-41fc-ad16-54da7b268812 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:00.964443 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-74109e72-361c-41fc-ad16-54da7b268812 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:01.106472 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-74109e72-361c-41fc-ad16-54da7b268812 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:01.113978 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-74109e72-361c-41fc-ad16-54da7b268812 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/48d80d94-ed1f-4792-955f-5ac166350cb8" status: 200 len: 1266 microversion: 2.1 time: 0.162700 May 31 21:12:01.114674 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 417/869] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:12:00 2022] GET /compute/v2.1/servers/48d80d94-ed1f-4792-955f-5ac166350cb8 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:12:01.278913 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-d722eead-3908-4cb7-88e9-adbe97f6d3b3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:12:01.279536 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-d722eead-3908-4cb7-88e9-adbe97f6d3b3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:12:01.286142 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d722eead-3908-4cb7-88e9-adbe97f6d3b3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:01.286594 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d722eead-3908-4cb7-88e9-adbe97f6d3b3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:01.287369 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d722eead-3908-4cb7-88e9-adbe97f6d3b3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:01.287800 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d722eead-3908-4cb7-88e9-adbe97f6d3b3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:01.418681 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-d722eead-3908-4cb7-88e9-adbe97f6d3b3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:01.426968 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-d722eead-3908-4cb7-88e9-adbe97f6d3b3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:01.428494 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-d722eead-3908-4cb7-88e9-adbe97f6d3b3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:01.429656 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-d722eead-3908-4cb7-88e9-adbe97f6d3b3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1719 microversion: 2.20 time: 0.155314 May 31 21:12:01.430327 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 453/870] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:12:01 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1719 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:12:02.129950 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-37699881-1ce8-4bbb-9b62-003f6051277e tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:12:02.130510 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-37699881-1ce8-4bbb-9b62-003f6051277e tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 48d80d94-ed1f-4792-955f-5ac166350cb8] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:12:02.137495 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-37699881-1ce8-4bbb-9b62-003f6051277e tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:02.137973 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-37699881-1ce8-4bbb-9b62-003f6051277e tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:02.138733 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-37699881-1ce8-4bbb-9b62-003f6051277e tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:02.139165 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-37699881-1ce8-4bbb-9b62-003f6051277e tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:02.270828 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-37699881-1ce8-4bbb-9b62-003f6051277e tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:02.279218 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-37699881-1ce8-4bbb-9b62-003f6051277e tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/48d80d94-ed1f-4792-955f-5ac166350cb8" status: 200 len: 1454 microversion: 2.1 time: 0.153234 May 31 21:12:02.279799 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 418/871] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:12:02 2022] GET /compute/v2.1/servers/48d80d94-ed1f-4792-955f-5ac166350cb8 => generated 1454 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:12:02.295235 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-34db62e1-c88f-4ae3-ad9b-155428591de2 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:12:02.295833 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-34db62e1-c88f-4ae3-ad9b-155428591de2 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 48d80d94-ed1f-4792-955f-5ac166350cb8] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:12:02.302485 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-34db62e1-c88f-4ae3-ad9b-155428591de2 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:02.302931 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-34db62e1-c88f-4ae3-ad9b-155428591de2 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:02.303684 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-34db62e1-c88f-4ae3-ad9b-155428591de2 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:02.304112 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-34db62e1-c88f-4ae3-ad9b-155428591de2 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:02.433761 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-34db62e1-c88f-4ae3-ad9b-155428591de2 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:02.441757 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-34db62e1-c88f-4ae3-ad9b-155428591de2 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/48d80d94-ed1f-4792-955f-5ac166350cb8" status: 200 len: 1454 microversion: 2.1 time: 0.150581 May 31 21:12:02.442348 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 454/872] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:12:02 2022] GET /compute/v2.1/servers/48d80d94-ed1f-4792-955f-5ac166350cb8 => generated 1454 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:12:02.447430 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-85059cf9-0f34-4dd4-af5d-da5a7b1b39bb tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:12:02.448037 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-85059cf9-0f34-4dd4-af5d-da5a7b1b39bb tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:12:02.454547 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-85059cf9-0f34-4dd4-af5d-da5a7b1b39bb tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:02.455002 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-85059cf9-0f34-4dd4-af5d-da5a7b1b39bb tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:02.455766 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-85059cf9-0f34-4dd4-af5d-da5a7b1b39bb tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:02.456198 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-85059cf9-0f34-4dd4-af5d-da5a7b1b39bb tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:02.606283 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-85059cf9-0f34-4dd4-af5d-da5a7b1b39bb tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:02.614190 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-85059cf9-0f34-4dd4-af5d-da5a7b1b39bb tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:02.615706 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-85059cf9-0f34-4dd4-af5d-da5a7b1b39bb tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:02.616998 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-85059cf9-0f34-4dd4-af5d-da5a7b1b39bb tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1719 microversion: 2.20 time: 0.173505 May 31 21:12:02.617552 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 419/873] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:12:02 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1719 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:12:03.635853 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-10fff8f1-047a-4b79-9be1-9597ccd6df1e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:12:03.636462 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-10fff8f1-047a-4b79-9be1-9597ccd6df1e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:12:03.643880 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-10fff8f1-047a-4b79-9be1-9597ccd6df1e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:03.644326 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-10fff8f1-047a-4b79-9be1-9597ccd6df1e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:03.645099 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-10fff8f1-047a-4b79-9be1-9597ccd6df1e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:03.645535 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-10fff8f1-047a-4b79-9be1-9597ccd6df1e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:04.035657 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-10fff8f1-047a-4b79-9be1-9597ccd6df1e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:04.043741 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-10fff8f1-047a-4b79-9be1-9597ccd6df1e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:04.045233 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-10fff8f1-047a-4b79-9be1-9597ccd6df1e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:04.046432 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-10fff8f1-047a-4b79-9be1-9597ccd6df1e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1719 microversion: 2.20 time: 0.414652 May 31 21:12:04.046989 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 455/874] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:12:03 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1719 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:12:04.766746 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [req-26ea26a1-a1ec-49b1-866a-6a3c62e9f4a2 req-090fd44f-a91d-493a-a1ea-6cc69a5d7572 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48d80d94-ed1f-4792-955f-5ac166350cb8", "tag": "be6188bf-51f6-4051-bc2f-677f9aefbc61"}]} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:12:04.775183 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-26ea26a1-a1ec-49b1-866a-6a3c62e9f4a2 req-090fd44f-a91d-493a-a1ea-6cc69a5d7572 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:04.775627 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-26ea26a1-a1ec-49b1-866a-6a3c62e9f4a2 req-090fd44f-a91d-493a-a1ea-6cc69a5d7572 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:04.787096 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.compute.server_external_events [req-26ea26a1-a1ec-49b1-866a-6a3c62e9f4a2 req-090fd44f-a91d-493a-a1ea-6cc69a5d7572 service nova] Creating event network-changed:be6188bf-51f6-4051-bc2f-677f9aefbc61 for instance 48d80d94-ed1f-4792-955f-5ac166350cb8 on hv-cinder-83979 May 31 21:12:04.793048 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [req-26ea26a1-a1ec-49b1-866a-6a3c62e9f4a2 req-090fd44f-a91d-493a-a1ea-6cc69a5d7572 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029499 May 31 21:12:04.794421 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 420/875] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:12:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 21:12:05.064953 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-d233bfda-88f1-42e0-8674-43601dd8f232 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:12:05.065937 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-d233bfda-88f1-42e0-8674-43601dd8f232 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:12:05.073039 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d233bfda-88f1-42e0-8674-43601dd8f232 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:05.073566 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d233bfda-88f1-42e0-8674-43601dd8f232 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:05.074471 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d233bfda-88f1-42e0-8674-43601dd8f232 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:05.074979 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d233bfda-88f1-42e0-8674-43601dd8f232 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:05.221222 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-d233bfda-88f1-42e0-8674-43601dd8f232 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:05.230326 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-d233bfda-88f1-42e0-8674-43601dd8f232 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:05.231924 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-d233bfda-88f1-42e0-8674-43601dd8f232 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:05.234096 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-d233bfda-88f1-42e0-8674-43601dd8f232 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1719 microversion: 2.20 time: 0.173350 May 31 21:12:05.234667 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 456/876] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:12:05 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1719 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:12:06.253584 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-49644f93-9bcf-41ce-9287-06f497cefa89 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:12:06.254306 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-49644f93-9bcf-41ce-9287-06f497cefa89 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:12:06.261346 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-49644f93-9bcf-41ce-9287-06f497cefa89 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:06.261794 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-49644f93-9bcf-41ce-9287-06f497cefa89 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:06.262594 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-49644f93-9bcf-41ce-9287-06f497cefa89 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:06.263030 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-49644f93-9bcf-41ce-9287-06f497cefa89 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:06.392611 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-49644f93-9bcf-41ce-9287-06f497cefa89 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:06.400580 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-49644f93-9bcf-41ce-9287-06f497cefa89 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:06.402136 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-49644f93-9bcf-41ce-9287-06f497cefa89 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:06.403838 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-49644f93-9bcf-41ce-9287-06f497cefa89 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1740 microversion: 2.20 time: 0.154753 May 31 21:12:06.404394 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 421/877] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:12:06 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1740 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:12:07.426136 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-0f7b3233-8e2d-41fd-90e3-32853c5bcc62 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:12:07.426769 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-0f7b3233-8e2d-41fd-90e3-32853c5bcc62 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:12:07.433447 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-0f7b3233-8e2d-41fd-90e3-32853c5bcc62 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:07.434507 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-0f7b3233-8e2d-41fd-90e3-32853c5bcc62 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:07.435270 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-0f7b3233-8e2d-41fd-90e3-32853c5bcc62 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:07.435700 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-0f7b3233-8e2d-41fd-90e3-32853c5bcc62 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:07.560672 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-0f7b3233-8e2d-41fd-90e3-32853c5bcc62 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:07.568747 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-0f7b3233-8e2d-41fd-90e3-32853c5bcc62 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:07.570278 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-0f7b3233-8e2d-41fd-90e3-32853c5bcc62 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:07.571529 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-0f7b3233-8e2d-41fd-90e3-32853c5bcc62 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1740 microversion: 2.20 time: 0.149299 May 31 21:12:07.572087 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 457/878] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:12:07 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1740 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:12:08.589718 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-e4367b1f-512f-4909-9420-1d29f99a0bb5 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:12:08.590840 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-e4367b1f-512f-4909-9420-1d29f99a0bb5 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:12:08.597383 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e4367b1f-512f-4909-9420-1d29f99a0bb5 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:08.597831 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e4367b1f-512f-4909-9420-1d29f99a0bb5 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:08.598621 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e4367b1f-512f-4909-9420-1d29f99a0bb5 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:08.599052 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e4367b1f-512f-4909-9420-1d29f99a0bb5 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:08.728605 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-e4367b1f-512f-4909-9420-1d29f99a0bb5 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:08.736819 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-e4367b1f-512f-4909-9420-1d29f99a0bb5 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:08.738351 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-e4367b1f-512f-4909-9420-1d29f99a0bb5 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:08.739499 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-e4367b1f-512f-4909-9420-1d29f99a0bb5 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1740 microversion: 2.20 time: 0.153707 May 31 21:12:08.740060 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 422/879] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:12:08 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1740 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:12:08.932364 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [req-6415a9bf-4cd2-4114-93fc-7b51c912a2de req-f525d85f-5937-4dde-9e5d-73e1582dfd0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d316a51-73db-479f-8449-ab51b42548e4", "name": "network-vif-plugged", "status": "completed", "tag": "ad3164a5-db8a-4332-a6c0-bcd7015cabda"}]} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:12:08.940968 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-6415a9bf-4cd2-4114-93fc-7b51c912a2de req-f525d85f-5937-4dde-9e5d-73e1582dfd0e service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:08.941410 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-6415a9bf-4cd2-4114-93fc-7b51c912a2de req-f525d85f-5937-4dde-9e5d-73e1582dfd0e service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:08.952866 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.compute.server_external_events [req-6415a9bf-4cd2-4114-93fc-7b51c912a2de req-f525d85f-5937-4dde-9e5d-73e1582dfd0e service nova] Creating event network-vif-plugged:ad3164a5-db8a-4332-a6c0-bcd7015cabda for instance 1d316a51-73db-479f-8449-ab51b42548e4 on hv-cinder-83979 May 31 21:12:08.958252 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [req-6415a9bf-4cd2-4114-93fc-7b51c912a2de req-f525d85f-5937-4dde-9e5d-73e1582dfd0e service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029159 May 31 21:12:08.959280 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 458/880] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:12:09.756766 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-d23c57d7-8d8c-4e43-ad3d-984bb86a6dee tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:12:09.757377 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-d23c57d7-8d8c-4e43-ad3d-984bb86a6dee tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:12:09.764442 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-d23c57d7-8d8c-4e43-ad3d-984bb86a6dee tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:09.764893 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-d23c57d7-8d8c-4e43-ad3d-984bb86a6dee tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:09.765660 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-d23c57d7-8d8c-4e43-ad3d-984bb86a6dee tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:09.766131 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-d23c57d7-8d8c-4e43-ad3d-984bb86a6dee tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:09.894711 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-d23c57d7-8d8c-4e43-ad3d-984bb86a6dee tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:09.903140 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-d23c57d7-8d8c-4e43-ad3d-984bb86a6dee tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:09.904672 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-d23c57d7-8d8c-4e43-ad3d-984bb86a6dee tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:09.905817 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-d23c57d7-8d8c-4e43-ad3d-984bb86a6dee tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1740 microversion: 2.20 time: 0.153013 May 31 21:12:09.906411 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 423/881] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:12:09 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1740 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:12:10.926219 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-c5933bc0-a675-44b2-a020-467f3005e280 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:12:10.926911 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-c5933bc0-a675-44b2-a020-467f3005e280 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:12:10.933085 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c5933bc0-a675-44b2-a020-467f3005e280 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:10.933570 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c5933bc0-a675-44b2-a020-467f3005e280 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:10.934344 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c5933bc0-a675-44b2-a020-467f3005e280 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:10.934775 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c5933bc0-a675-44b2-a020-467f3005e280 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:11.064554 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-c5933bc0-a675-44b2-a020-467f3005e280 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:11.072353 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-c5933bc0-a675-44b2-a020-467f3005e280 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:11.073839 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-c5933bc0-a675-44b2-a020-467f3005e280 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:11.075007 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-c5933bc0-a675-44b2-a020-467f3005e280 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1740 microversion: 2.20 time: 0.153731 May 31 21:12:11.075573 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 459/882] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:12:10 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1740 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:12:12.094217 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-a734b31a-e391-4ae5-b137-264b231ec132 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:12:12.095584 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-a734b31a-e391-4ae5-b137-264b231ec132 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:12:12.102588 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a734b31a-e391-4ae5-b137-264b231ec132 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:12.102791 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a734b31a-e391-4ae5-b137-264b231ec132 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:12.103772 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a734b31a-e391-4ae5-b137-264b231ec132 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:12.104215 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a734b31a-e391-4ae5-b137-264b231ec132 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:12.267249 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-a734b31a-e391-4ae5-b137-264b231ec132 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:12.292563 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-a734b31a-e391-4ae5-b137-264b231ec132 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:12.294344 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-a734b31a-e391-4ae5-b137-264b231ec132 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:12.295659 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-a734b31a-e391-4ae5-b137-264b231ec132 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1735 microversion: 2.20 time: 0.206164 May 31 21:12:12.298020 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 424/883] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:12:12 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1735 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:12:13.316728 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-87b02ec1-9b33-45b2-8769-fb44e1cdde26 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:12:13.318058 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-87b02ec1-9b33-45b2-8769-fb44e1cdde26 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:12:13.325698 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-87b02ec1-9b33-45b2-8769-fb44e1cdde26 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:13.326321 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-87b02ec1-9b33-45b2-8769-fb44e1cdde26 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:13.327414 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-87b02ec1-9b33-45b2-8769-fb44e1cdde26 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:13.328088 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-87b02ec1-9b33-45b2-8769-fb44e1cdde26 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:13.475746 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-87b02ec1-9b33-45b2-8769-fb44e1cdde26 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:13.484887 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-87b02ec1-9b33-45b2-8769-fb44e1cdde26 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:13.486398 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-87b02ec1-9b33-45b2-8769-fb44e1cdde26 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:13.487755 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-87b02ec1-9b33-45b2-8769-fb44e1cdde26 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1735 microversion: 2.20 time: 0.175585 May 31 21:12:13.498816 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 460/884] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:12:13 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1735 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:12:14.506910 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-400beb90-b5a8-4408-bde8-65f3dff4e039 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:12:14.507514 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-400beb90-b5a8-4408-bde8-65f3dff4e039 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:12:14.516608 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-400beb90-b5a8-4408-bde8-65f3dff4e039 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:14.517064 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-400beb90-b5a8-4408-bde8-65f3dff4e039 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:14.517871 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-400beb90-b5a8-4408-bde8-65f3dff4e039 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:14.518348 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-400beb90-b5a8-4408-bde8-65f3dff4e039 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:14.666706 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-400beb90-b5a8-4408-bde8-65f3dff4e039 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:14.675337 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-400beb90-b5a8-4408-bde8-65f3dff4e039 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:14.676865 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-400beb90-b5a8-4408-bde8-65f3dff4e039 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:14.678115 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-400beb90-b5a8-4408-bde8-65f3dff4e039 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1735 microversion: 2.20 time: 0.175244 May 31 21:12:14.678691 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 425/885] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:12:14 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:12:15.699337 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-9fe6c0ca-2777-4684-95ae-bee86adac1f3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:12:15.699961 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-9fe6c0ca-2777-4684-95ae-bee86adac1f3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:12:15.707406 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-9fe6c0ca-2777-4684-95ae-bee86adac1f3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:15.708388 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-9fe6c0ca-2777-4684-95ae-bee86adac1f3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:15.709358 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-9fe6c0ca-2777-4684-95ae-bee86adac1f3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:15.710011 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-9fe6c0ca-2777-4684-95ae-bee86adac1f3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:15.866989 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-9fe6c0ca-2777-4684-95ae-bee86adac1f3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:15.875822 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-9fe6c0ca-2777-4684-95ae-bee86adac1f3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:15.877389 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-9fe6c0ca-2777-4684-95ae-bee86adac1f3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:15.878924 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-9fe6c0ca-2777-4684-95ae-bee86adac1f3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1735 microversion: 2.20 time: 0.185564 May 31 21:12:15.879134 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 461/886] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:12:15 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1735 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:12:16.897883 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-bfc2bdda-3e4f-412d-97d4-156be64b36a3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:12:16.898645 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-bfc2bdda-3e4f-412d-97d4-156be64b36a3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:12:16.906915 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-bfc2bdda-3e4f-412d-97d4-156be64b36a3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:16.907680 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-bfc2bdda-3e4f-412d-97d4-156be64b36a3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:16.908580 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-bfc2bdda-3e4f-412d-97d4-156be64b36a3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:16.909097 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-bfc2bdda-3e4f-412d-97d4-156be64b36a3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:16.924935 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:12:17.060698 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-bfc2bdda-3e4f-412d-97d4-156be64b36a3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:17.069388 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-bfc2bdda-3e4f-412d-97d4-156be64b36a3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:17.071061 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-bfc2bdda-3e4f-412d-97d4-156be64b36a3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:17.072308 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-bfc2bdda-3e4f-412d-97d4-156be64b36a3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1735 microversion: 2.20 time: 0.178331 May 31 21:12:17.072980 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 426/887] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:12:16 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1735 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:12:18.092883 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-727b351e-71e1-472d-82ea-2307efbf2525 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:12:18.093437 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-727b351e-71e1-472d-82ea-2307efbf2525 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:12:18.101025 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-727b351e-71e1-472d-82ea-2307efbf2525 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:18.101482 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-727b351e-71e1-472d-82ea-2307efbf2525 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:18.102284 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-727b351e-71e1-472d-82ea-2307efbf2525 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:18.102721 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-727b351e-71e1-472d-82ea-2307efbf2525 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:18.241678 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-727b351e-71e1-472d-82ea-2307efbf2525 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:18.250721 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-727b351e-71e1-472d-82ea-2307efbf2525 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:18.252233 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-727b351e-71e1-472d-82ea-2307efbf2525 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:18.253400 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-727b351e-71e1-472d-82ea-2307efbf2525 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1735 microversion: 2.20 time: 0.165092 May 31 21:12:18.253984 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 462/888] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:12:18 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 21:12:19.273485 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-9588fe78-400b-46fd-aee7-7e9a99f0947a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:12:19.274830 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-9588fe78-400b-46fd-aee7-7e9a99f0947a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:12:19.281352 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9588fe78-400b-46fd-aee7-7e9a99f0947a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:19.281992 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9588fe78-400b-46fd-aee7-7e9a99f0947a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:19.284399 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9588fe78-400b-46fd-aee7-7e9a99f0947a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:19.284399 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9588fe78-400b-46fd-aee7-7e9a99f0947a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:19.443348 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-9588fe78-400b-46fd-aee7-7e9a99f0947a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:19.452361 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-9588fe78-400b-46fd-aee7-7e9a99f0947a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:19.453868 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-9588fe78-400b-46fd-aee7-7e9a99f0947a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:19.455467 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-9588fe78-400b-46fd-aee7-7e9a99f0947a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1735 microversion: 2.20 time: 0.187324 May 31 21:12:19.466286 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 427/889] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:12:19 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1735 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:12:20.474254 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-b8154809-681f-4465-8a4f-c70fe34e1184 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:12:20.475100 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-b8154809-681f-4465-8a4f-c70fe34e1184 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:12:20.481755 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b8154809-681f-4465-8a4f-c70fe34e1184 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:20.482243 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b8154809-681f-4465-8a4f-c70fe34e1184 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:20.483029 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b8154809-681f-4465-8a4f-c70fe34e1184 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:20.483474 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b8154809-681f-4465-8a4f-c70fe34e1184 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:20.627528 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-b8154809-681f-4465-8a4f-c70fe34e1184 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:20.635680 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-b8154809-681f-4465-8a4f-c70fe34e1184 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:20.637848 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-b8154809-681f-4465-8a4f-c70fe34e1184 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:20.639024 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-b8154809-681f-4465-8a4f-c70fe34e1184 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1735 microversion: 2.20 time: 0.168828 May 31 21:12:20.639709 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 463/890] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:12:20 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:12:21.657618 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-1c166d52-ea50-43cf-b367-603f71ba9379 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:12:21.658958 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-1c166d52-ea50-43cf-b367-603f71ba9379 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:12:21.665372 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-1c166d52-ea50-43cf-b367-603f71ba9379 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:21.666058 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-1c166d52-ea50-43cf-b367-603f71ba9379 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:21.666839 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-1c166d52-ea50-43cf-b367-603f71ba9379 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:21.667280 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-1c166d52-ea50-43cf-b367-603f71ba9379 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:21.822983 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-1c166d52-ea50-43cf-b367-603f71ba9379 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:21.822983 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-1c166d52-ea50-43cf-b367-603f71ba9379 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:21.823238 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-1c166d52-ea50-43cf-b367-603f71ba9379 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:21.823238 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-1c166d52-ea50-43cf-b367-603f71ba9379 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1735 microversion: 2.20 time: 0.162448 May 31 21:12:21.823238 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 428/891] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:12:21 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:12:22.835802 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-03098dc5-8986-49f8-bfaf-4b35e8d9bb55 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:12:22.836467 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-03098dc5-8986-49f8-bfaf-4b35e8d9bb55 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:12:22.843699 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-03098dc5-8986-49f8-bfaf-4b35e8d9bb55 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:22.844316 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-03098dc5-8986-49f8-bfaf-4b35e8d9bb55 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:22.845100 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-03098dc5-8986-49f8-bfaf-4b35e8d9bb55 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:22.845560 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-03098dc5-8986-49f8-bfaf-4b35e8d9bb55 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:22.992055 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-03098dc5-8986-49f8-bfaf-4b35e8d9bb55 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:23.000820 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-03098dc5-8986-49f8-bfaf-4b35e8d9bb55 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:23.002350 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-03098dc5-8986-49f8-bfaf-4b35e8d9bb55 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:23.003693 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-03098dc5-8986-49f8-bfaf-4b35e8d9bb55 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1735 microversion: 2.20 time: 0.172103 May 31 21:12:23.004255 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 464/892] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:12:22 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:12:24.022393 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-e4b11de3-dd09-48a4-890d-51593cda1b77 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:12:24.022948 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-e4b11de3-dd09-48a4-890d-51593cda1b77 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:12:24.030361 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e4b11de3-dd09-48a4-890d-51593cda1b77 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:24.030820 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e4b11de3-dd09-48a4-890d-51593cda1b77 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:24.031633 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e4b11de3-dd09-48a4-890d-51593cda1b77 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:24.032079 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e4b11de3-dd09-48a4-890d-51593cda1b77 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:24.162710 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-e4b11de3-dd09-48a4-890d-51593cda1b77 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:24.170713 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-e4b11de3-dd09-48a4-890d-51593cda1b77 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:24.172286 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-e4b11de3-dd09-48a4-890d-51593cda1b77 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:24.173573 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-e4b11de3-dd09-48a4-890d-51593cda1b77 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1735 microversion: 2.20 time: 0.155211 May 31 21:12:24.174177 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 429/893] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:12:24 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:12:25.191499 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-66817c71-5930-4d01-a776-0738666576e0 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:12:25.192106 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-66817c71-5930-4d01-a776-0738666576e0 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:12:25.198744 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-66817c71-5930-4d01-a776-0738666576e0 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:25.199784 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-66817c71-5930-4d01-a776-0738666576e0 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:25.200563 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-66817c71-5930-4d01-a776-0738666576e0 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:25.201003 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-66817c71-5930-4d01-a776-0738666576e0 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:25.333558 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-66817c71-5930-4d01-a776-0738666576e0 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:25.341664 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-66817c71-5930-4d01-a776-0738666576e0 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:25.343179 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-66817c71-5930-4d01-a776-0738666576e0 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:25.344365 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-66817c71-5930-4d01-a776-0738666576e0 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1717 microversion: 2.20 time: 0.156784 May 31 21:12:25.344933 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 465/894] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:12:25 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1717 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:12:26.362760 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-761a7eba-d36c-42db-8a49-05ddfd8683a1 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:12:26.363367 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-761a7eba-d36c-42db-8a49-05ddfd8683a1 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:12:26.365774 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_api:SELECT=36 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:12:26.370898 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-761a7eba-d36c-42db-8a49-05ddfd8683a1 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:26.371348 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-761a7eba-d36c-42db-8a49-05ddfd8683a1 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:26.372133 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-761a7eba-d36c-42db-8a49-05ddfd8683a1 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:26.372577 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-761a7eba-d36c-42db-8a49-05ddfd8683a1 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:26.513059 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-761a7eba-d36c-42db-8a49-05ddfd8683a1 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:26.521235 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-761a7eba-d36c-42db-8a49-05ddfd8683a1 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:26.522892 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-761a7eba-d36c-42db-8a49-05ddfd8683a1 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:26.524066 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-761a7eba-d36c-42db-8a49-05ddfd8683a1 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1717 microversion: 2.20 time: 0.165223 May 31 21:12:26.524918 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 430/895] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:12:26 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1717 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:12:27.548087 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-63d665c6-6398-4e06-98df-babb02deba65 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:12:27.548087 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-63d665c6-6398-4e06-98df-babb02deba65 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:12:27.548087 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_api:SELECT=34 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:12:27.551608 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-63d665c6-6398-4e06-98df-babb02deba65 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:27.552064 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-63d665c6-6398-4e06-98df-babb02deba65 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:27.552852 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-63d665c6-6398-4e06-98df-babb02deba65 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:27.553287 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-63d665c6-6398-4e06-98df-babb02deba65 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:27.686565 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-63d665c6-6398-4e06-98df-babb02deba65 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:27.694642 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-63d665c6-6398-4e06-98df-babb02deba65 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:27.696065 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-63d665c6-6398-4e06-98df-babb02deba65 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:27.697212 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-63d665c6-6398-4e06-98df-babb02deba65 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1660 microversion: 2.20 time: 0.158450 May 31 21:12:27.697761 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 466/896] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:12:27 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1660 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:12:27.717013 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-67b3ea2e-1185-457d-a2b5-a4f4cefc2583 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a350adb7-6f47-4ec3-b57c-b919b641d6ff"}} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:12:27.718229 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-67b3ea2e-1185-457d-a2b5-a4f4cefc2583 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:12:27.724736 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-67b3ea2e-1185-457d-a2b5-a4f4cefc2583 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:27.725178 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-67b3ea2e-1185-457d-a2b5-a4f4cefc2583 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:27.725964 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-67b3ea2e-1185-457d-a2b5-a4f4cefc2583 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:27.726399 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-67b3ea2e-1185-457d-a2b5-a4f4cefc2583 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:28.682897 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-67b3ea2e-1185-457d-a2b5-a4f4cefc2583 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "POST /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.970500 May 31 21:12:28.684182 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 431/897] 10.222.0.55 () {62 vars in 1363 bytes} [Tue May 31 21:12:27 2022] POST /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4/os-volume_attachments => generated 188 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 21:12:28.796337 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-011cb3de-688e-4898-b52e-cf04887e0d7e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:12:28.796830 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-011cb3de-688e-4898-b52e-cf04887e0d7e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:12:28.803278 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-011cb3de-688e-4898-b52e-cf04887e0d7e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:28.803718 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-011cb3de-688e-4898-b52e-cf04887e0d7e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:28.804474 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-011cb3de-688e-4898-b52e-cf04887e0d7e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:28.804906 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-011cb3de-688e-4898-b52e-cf04887e0d7e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:28.807351 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell1:SELECT=97 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:12:29.154155 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [req-d8f25e4a-c7e0-4366-a99f-3a274b6555d7 req-cbb82cb9-3ae6-498d-ad8b-d203364f76d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d316a51-73db-479f-8449-ab51b42548e4", "name": "network-vif-unplugged", "status": "completed", "tag": "ad3164a5-db8a-4332-a6c0-bcd7015cabda"}]} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:12:29.163667 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-d8f25e4a-c7e0-4366-a99f-3a274b6555d7 req-cbb82cb9-3ae6-498d-ad8b-d203364f76d2 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:29.164111 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-d8f25e4a-c7e0-4366-a99f-3a274b6555d7 req-cbb82cb9-3ae6-498d-ad8b-d203364f76d2 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:29.174304 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.compute.server_external_events [req-d8f25e4a-c7e0-4366-a99f-3a274b6555d7 req-cbb82cb9-3ae6-498d-ad8b-d203364f76d2 service nova] Unable to find a host for instance 1d316a51-73db-479f-8449-ab51b42548e4. Dropping event network-vif-unplugged {{(pid=118185) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 31 21:12:29.175192 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [req-d8f25e4a-c7e0-4366-a99f-3a274b6555d7 req-cbb82cb9-3ae6-498d-ad8b-d203364f76d2 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.025671 May 31 21:12:29.175790 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 432/898] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:12:29 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) May 31 21:12:29.399139 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-011cb3de-688e-4898-b52e-cf04887e0d7e tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "DELETE /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4/os-volume_attachments/a350adb7-6f47-4ec3-b57c-b919b641d6ff" status: 202 len: 0 microversion: 2.20 time: 0.607136 May 31 21:12:29.399693 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 467/899] 10.222.0.55 () {60 vars in 1456 bytes} [Tue May 31 21:12:28 2022] DELETE /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4/os-volume_attachments/a350adb7-6f47-4ec3-b57c-b919b641d6ff => generated 0 bytes in 609 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 31 21:12:29.454922 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-bcde0341-2f83-4a4b-a7ad-d866dc7f3926 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:12:29.455490 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-bcde0341-2f83-4a4b-a7ad-d866dc7f3926 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:12:29.461760 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-bcde0341-2f83-4a4b-a7ad-d866dc7f3926 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:29.462243 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-bcde0341-2f83-4a4b-a7ad-d866dc7f3926 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:29.463010 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-bcde0341-2f83-4a4b-a7ad-d866dc7f3926 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:29.463453 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-bcde0341-2f83-4a4b-a7ad-d866dc7f3926 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:29.721746 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-bcde0341-2f83-4a4b-a7ad-d866dc7f3926 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "POST /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4/action" status: 202 len: 0 microversion: 2.20 time: 0.270742 May 31 21:12:29.722383 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 433/900] 10.222.0.55 () {62 vars in 1318 bytes} [Tue May 31 21:12:29 2022] POST /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4/action => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 31 21:12:29.730500 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-6f25b84b-b41a-4e28-8787-5b007fb1ae59 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:12:29.731107 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-6f25b84b-b41a-4e28-8787-5b007fb1ae59 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:12:29.737825 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6f25b84b-b41a-4e28-8787-5b007fb1ae59 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:29.738308 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6f25b84b-b41a-4e28-8787-5b007fb1ae59 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:29.739083 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6f25b84b-b41a-4e28-8787-5b007fb1ae59 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:29.739520 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6f25b84b-b41a-4e28-8787-5b007fb1ae59 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:29.875857 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-6f25b84b-b41a-4e28-8787-5b007fb1ae59 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:29.883946 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-6f25b84b-b41a-4e28-8787-5b007fb1ae59 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:29.885479 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-6f25b84b-b41a-4e28-8787-5b007fb1ae59 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:29.887358 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-6f25b84b-b41a-4e28-8787-5b007fb1ae59 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1668 microversion: 2.20 time: 0.160714 May 31 21:12:29.887915 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 468/901] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:12:29 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1668 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 21:12:30.906991 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-60cfbe28-56ed-410a-a771-761d3c8ebb00 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:12:30.907626 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-60cfbe28-56ed-410a-a771-761d3c8ebb00 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:12:30.914669 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-60cfbe28-56ed-410a-a771-761d3c8ebb00 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:30.915114 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-60cfbe28-56ed-410a-a771-761d3c8ebb00 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:30.915880 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-60cfbe28-56ed-410a-a771-761d3c8ebb00 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:30.916311 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-60cfbe28-56ed-410a-a771-761d3c8ebb00 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:31.046425 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-60cfbe28-56ed-410a-a771-761d3c8ebb00 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:31.055176 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-60cfbe28-56ed-410a-a771-761d3c8ebb00 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:31.056700 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-60cfbe28-56ed-410a-a771-761d3c8ebb00 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:31.057931 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-60cfbe28-56ed-410a-a771-761d3c8ebb00 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1670 microversion: 2.20 time: 0.156094 May 31 21:12:31.059007 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 434/902] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:12:30 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1670 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:12:32.077087 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-c1272e19-e558-4f32-b680-8994bd9d76f5 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:12:32.077692 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-c1272e19-e558-4f32-b680-8994bd9d76f5 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:12:32.084685 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c1272e19-e558-4f32-b680-8994bd9d76f5 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:32.085131 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c1272e19-e558-4f32-b680-8994bd9d76f5 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:32.085914 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c1272e19-e558-4f32-b680-8994bd9d76f5 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:32.086349 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c1272e19-e558-4f32-b680-8994bd9d76f5 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:32.219056 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-c1272e19-e558-4f32-b680-8994bd9d76f5 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:32.226917 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-c1272e19-e558-4f32-b680-8994bd9d76f5 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:32.228411 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-c1272e19-e558-4f32-b680-8994bd9d76f5 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:32.229553 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-c1272e19-e558-4f32-b680-8994bd9d76f5 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1726 microversion: 2.20 time: 0.156471 May 31 21:12:32.230138 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 469/903] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:12:32 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:12:33.249444 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-6da3399b-c919-47f8-8e06-0acd6d365c22 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:12:33.250987 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-6da3399b-c919-47f8-8e06-0acd6d365c22 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:12:33.258428 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-6da3399b-c919-47f8-8e06-0acd6d365c22 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:33.259224 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-6da3399b-c919-47f8-8e06-0acd6d365c22 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:33.260147 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-6da3399b-c919-47f8-8e06-0acd6d365c22 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:33.260679 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-6da3399b-c919-47f8-8e06-0acd6d365c22 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:33.399689 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-6da3399b-c919-47f8-8e06-0acd6d365c22 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:33.409180 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-6da3399b-c919-47f8-8e06-0acd6d365c22 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:33.410723 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-6da3399b-c919-47f8-8e06-0acd6d365c22 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:33.411888 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-6da3399b-c919-47f8-8e06-0acd6d365c22 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1726 microversion: 2.20 time: 0.168005 May 31 21:12:33.412452 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 435/904] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:12:33 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1726 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:12:34.434997 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-9dd1045c-b7b4-44ab-a010-80b687c57efc tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:12:34.435588 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-9dd1045c-b7b4-44ab-a010-80b687c57efc tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:12:34.442866 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-9dd1045c-b7b4-44ab-a010-80b687c57efc tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:34.443311 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-9dd1045c-b7b4-44ab-a010-80b687c57efc tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:34.444090 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-9dd1045c-b7b4-44ab-a010-80b687c57efc tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:34.444528 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-9dd1045c-b7b4-44ab-a010-80b687c57efc tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:34.584992 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-9dd1045c-b7b4-44ab-a010-80b687c57efc tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:34.593553 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-9dd1045c-b7b4-44ab-a010-80b687c57efc tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:34.595114 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-9dd1045c-b7b4-44ab-a010-80b687c57efc tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:34.596293 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-9dd1045c-b7b4-44ab-a010-80b687c57efc tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1726 microversion: 2.20 time: 0.165843 May 31 21:12:34.597005 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 470/905] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:12:34 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1726 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:12:34.888732 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-eff81743-4273-4bfc-b60e-261b86bdae5b tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:12:34.889385 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-eff81743-4273-4bfc-b60e-261b86bdae5b tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: e26c2265-9a33-4c2a-9e41-6bf685f4c525] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:12:34.895952 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-eff81743-4273-4bfc-b60e-261b86bdae5b tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:34.896410 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-eff81743-4273-4bfc-b60e-261b86bdae5b tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:34.897182 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-eff81743-4273-4bfc-b60e-261b86bdae5b tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:34.897619 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-eff81743-4273-4bfc-b60e-261b86bdae5b tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:34.922351 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-eff81743-4273-4bfc-b60e-261b86bdae5b tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525/ips" status: 200 len: 145 microversion: 2.1 time: 0.037304 May 31 21:12:34.922926 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 436/906] 10.222.0.55 () {58 vars in 1247 bytes} [Tue May 31 21:12:34 2022] GET /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525/ips => generated 145 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:12:35.614787 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-5a1d04af-5fb8-43b9-a6ea-9b21f8088afa tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:12:35.615372 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-5a1d04af-5fb8-43b9-a6ea-9b21f8088afa tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:12:35.621968 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5a1d04af-5fb8-43b9-a6ea-9b21f8088afa tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:35.622422 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5a1d04af-5fb8-43b9-a6ea-9b21f8088afa tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:35.623246 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5a1d04af-5fb8-43b9-a6ea-9b21f8088afa tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:35.623690 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5a1d04af-5fb8-43b9-a6ea-9b21f8088afa tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:35.802647 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-5a1d04af-5fb8-43b9-a6ea-9b21f8088afa tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:35.812030 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-5a1d04af-5fb8-43b9-a6ea-9b21f8088afa tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:35.813695 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-5a1d04af-5fb8-43b9-a6ea-9b21f8088afa tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:35.814875 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-5a1d04af-5fb8-43b9-a6ea-9b21f8088afa tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1726 microversion: 2.20 time: 0.204045 May 31 21:12:35.815435 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 471/907] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:12:35 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1726 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:12:36.833137 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-08412c59-cc76-4b0e-b0fb-abf3f40f4931 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:12:36.833816 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-08412c59-cc76-4b0e-b0fb-abf3f40f4931 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:12:36.841238 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-08412c59-cc76-4b0e-b0fb-abf3f40f4931 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:36.841693 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-08412c59-cc76-4b0e-b0fb-abf3f40f4931 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:36.842502 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-08412c59-cc76-4b0e-b0fb-abf3f40f4931 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:36.842945 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-08412c59-cc76-4b0e-b0fb-abf3f40f4931 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:36.987307 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-08412c59-cc76-4b0e-b0fb-abf3f40f4931 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:36.996205 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-08412c59-cc76-4b0e-b0fb-abf3f40f4931 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:36.997960 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-08412c59-cc76-4b0e-b0fb-abf3f40f4931 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:36.999154 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-08412c59-cc76-4b0e-b0fb-abf3f40f4931 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1726 microversion: 2.20 time: 0.170295 May 31 21:12:36.999726 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 437/908] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:12:36 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1726 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:12:37.705887 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-38866009-1674-437c-9ae3-a0753a7a15a3 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "21d31bf3-1820-490d-a69a-a8a6d9ec7abe"}} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:12:37.707031 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-38866009-1674-437c-9ae3-a0753a7a15a3 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: e26c2265-9a33-4c2a-9e41-6bf685f4c525] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:12:37.714022 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-38866009-1674-437c-9ae3-a0753a7a15a3 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:37.714472 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-38866009-1674-437c-9ae3-a0753a7a15a3 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:37.715246 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-38866009-1674-437c-9ae3-a0753a7a15a3 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:37.715686 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-38866009-1674-437c-9ae3-a0753a7a15a3 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:38.016661 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-a65b3822-ca3b-4156-9a24-e6c76be88232 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:12:38.017469 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-a65b3822-ca3b-4156-9a24-e6c76be88232 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:12:38.024976 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a65b3822-ca3b-4156-9a24-e6c76be88232 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:38.025435 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a65b3822-ca3b-4156-9a24-e6c76be88232 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:38.026255 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a65b3822-ca3b-4156-9a24-e6c76be88232 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:38.027215 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a65b3822-ca3b-4156-9a24-e6c76be88232 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:38.164128 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-a65b3822-ca3b-4156-9a24-e6c76be88232 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:38.172434 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-a65b3822-ca3b-4156-9a24-e6c76be88232 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:38.174331 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-a65b3822-ca3b-4156-9a24-e6c76be88232 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:38.175761 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-a65b3822-ca3b-4156-9a24-e6c76be88232 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1726 microversion: 2.20 time: 0.163048 May 31 21:12:38.178468 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 438/909] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:12:38 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1726 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 21:12:39.202650 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-f01108ac-63bd-42b0-9fbc-2e2183782491 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:12:39.204943 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-f01108ac-63bd-42b0-9fbc-2e2183782491 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:12:39.214830 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f01108ac-63bd-42b0-9fbc-2e2183782491 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:39.215276 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f01108ac-63bd-42b0-9fbc-2e2183782491 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:39.216677 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f01108ac-63bd-42b0-9fbc-2e2183782491 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:39.217112 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f01108ac-63bd-42b0-9fbc-2e2183782491 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:39.369338 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-f01108ac-63bd-42b0-9fbc-2e2183782491 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:39.380834 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-f01108ac-63bd-42b0-9fbc-2e2183782491 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:39.383801 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-f01108ac-63bd-42b0-9fbc-2e2183782491 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:39.384051 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-f01108ac-63bd-42b0-9fbc-2e2183782491 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1726 microversion: 2.20 time: 0.191342 May 31 21:12:39.384710 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 439/910] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:12:39 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1726 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:12:40.402702 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-f72be25a-d00f-48e1-bbfd-593169beec1d tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:12:40.403461 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-f72be25a-d00f-48e1-bbfd-593169beec1d tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:12:40.409992 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f72be25a-d00f-48e1-bbfd-593169beec1d tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:40.410454 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f72be25a-d00f-48e1-bbfd-593169beec1d tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:40.411235 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f72be25a-d00f-48e1-bbfd-593169beec1d tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:40.411688 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f72be25a-d00f-48e1-bbfd-593169beec1d tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:40.415712 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:12:40.566495 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-f72be25a-d00f-48e1-bbfd-593169beec1d tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:40.575928 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-f72be25a-d00f-48e1-bbfd-593169beec1d tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:40.577578 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-f72be25a-d00f-48e1-bbfd-593169beec1d tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:40.579002 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-f72be25a-d00f-48e1-bbfd-593169beec1d tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1726 microversion: 2.20 time: 0.180145 May 31 21:12:40.579794 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 440/911] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:12:40 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1726 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 21:12:41.597836 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-24789d32-9dde-4181-9e0c-8df0a30860bc tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:12:41.598653 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-24789d32-9dde-4181-9e0c-8df0a30860bc tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:12:41.605912 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-24789d32-9dde-4181-9e0c-8df0a30860bc tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:41.606969 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-24789d32-9dde-4181-9e0c-8df0a30860bc tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:41.607754 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-24789d32-9dde-4181-9e0c-8df0a30860bc tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:41.608198 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-24789d32-9dde-4181-9e0c-8df0a30860bc tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:41.745507 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-24789d32-9dde-4181-9e0c-8df0a30860bc tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:41.754421 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-24789d32-9dde-4181-9e0c-8df0a30860bc tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:41.756020 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-24789d32-9dde-4181-9e0c-8df0a30860bc tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:41.757376 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-24789d32-9dde-4181-9e0c-8df0a30860bc tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1726 microversion: 2.20 time: 0.163716 May 31 21:12:41.765630 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 441/912] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:12:41 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1726 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 21:12:42.776367 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-6bf62faa-b31f-4723-9905-3739d88bfce3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:12:42.777088 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-6bf62faa-b31f-4723-9905-3739d88bfce3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:12:42.786161 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-6bf62faa-b31f-4723-9905-3739d88bfce3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:42.789401 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-6bf62faa-b31f-4723-9905-3739d88bfce3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:42.789401 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-6bf62faa-b31f-4723-9905-3739d88bfce3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:42.789401 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-6bf62faa-b31f-4723-9905-3739d88bfce3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:42.977341 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-6bf62faa-b31f-4723-9905-3739d88bfce3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:42.977341 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-6bf62faa-b31f-4723-9905-3739d88bfce3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:42.977652 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-6bf62faa-b31f-4723-9905-3739d88bfce3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:42.977652 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-6bf62faa-b31f-4723-9905-3739d88bfce3 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1726 microversion: 2.20 time: 0.178316 May 31 21:12:42.977652 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 442/913] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:12:42 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1726 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 21:12:43.987610 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-c876e68f-624c-46b6-9f3f-3161141b38c6 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:12:43.988372 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-c876e68f-624c-46b6-9f3f-3161141b38c6 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:12:43.994665 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c876e68f-624c-46b6-9f3f-3161141b38c6 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:43.995163 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c876e68f-624c-46b6-9f3f-3161141b38c6 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:43.995935 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c876e68f-624c-46b6-9f3f-3161141b38c6 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:43.996372 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c876e68f-624c-46b6-9f3f-3161141b38c6 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:44.130525 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-c876e68f-624c-46b6-9f3f-3161141b38c6 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:44.138431 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-c876e68f-624c-46b6-9f3f-3161141b38c6 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:44.139926 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-c876e68f-624c-46b6-9f3f-3161141b38c6 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:44.141079 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-c876e68f-624c-46b6-9f3f-3161141b38c6 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1726 microversion: 2.20 time: 0.157447 May 31 21:12:44.141642 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 443/914] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:12:43 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 21:12:45.159220 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-1849f3a1-ec11-4b26-9313-7cfc392794d1 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:12:45.159888 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-1849f3a1-ec11-4b26-9313-7cfc392794d1 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:12:45.166331 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-1849f3a1-ec11-4b26-9313-7cfc392794d1 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:45.169076 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-1849f3a1-ec11-4b26-9313-7cfc392794d1 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:45.169076 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-1849f3a1-ec11-4b26-9313-7cfc392794d1 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:45.169076 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-1849f3a1-ec11-4b26-9313-7cfc392794d1 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:45.302005 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-1849f3a1-ec11-4b26-9313-7cfc392794d1 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:45.310021 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-1849f3a1-ec11-4b26-9313-7cfc392794d1 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:45.312029 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-1849f3a1-ec11-4b26-9313-7cfc392794d1 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:45.313184 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-1849f3a1-ec11-4b26-9313-7cfc392794d1 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1726 microversion: 2.20 time: 0.157840 May 31 21:12:45.313734 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 444/915] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:12:45 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 21:12:46.331093 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-e0f066ae-75ed-4da9-9c75-279001700a93 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:12:46.331786 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-e0f066ae-75ed-4da9-9c75-279001700a93 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:12:46.338395 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e0f066ae-75ed-4da9-9c75-279001700a93 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:46.338852 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e0f066ae-75ed-4da9-9c75-279001700a93 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:46.339625 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e0f066ae-75ed-4da9-9c75-279001700a93 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:46.340085 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e0f066ae-75ed-4da9-9c75-279001700a93 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:46.467645 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-e0f066ae-75ed-4da9-9c75-279001700a93 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:46.476188 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-e0f066ae-75ed-4da9-9c75-279001700a93 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:46.477693 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-e0f066ae-75ed-4da9-9c75-279001700a93 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:46.478875 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-e0f066ae-75ed-4da9-9c75-279001700a93 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1726 microversion: 2.20 time: 0.152288 May 31 21:12:46.479426 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 445/916] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:12:46 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 21:12:47.496619 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-4f0054b6-a9ed-413b-8de4-2e431b6167e7 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:12:47.497293 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-4f0054b6-a9ed-413b-8de4-2e431b6167e7 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:12:47.504323 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4f0054b6-a9ed-413b-8de4-2e431b6167e7 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:47.504771 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4f0054b6-a9ed-413b-8de4-2e431b6167e7 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:47.505524 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4f0054b6-a9ed-413b-8de4-2e431b6167e7 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:47.505985 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4f0054b6-a9ed-413b-8de4-2e431b6167e7 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:47.635075 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-4f0054b6-a9ed-413b-8de4-2e431b6167e7 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:47.643505 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-4f0054b6-a9ed-413b-8de4-2e431b6167e7 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:47.645004 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-4f0054b6-a9ed-413b-8de4-2e431b6167e7 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:47.646183 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-4f0054b6-a9ed-413b-8de4-2e431b6167e7 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1726 microversion: 2.20 time: 0.153490 May 31 21:12:47.646747 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 446/917] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:12:47 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 21:12:47.711684 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_api:SELECT=13 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:12:47.791892 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell1:SELECT=44,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:12:48.664627 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-ff0c5505-9d8c-442c-8a54-d9dcc30cb689 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:12:48.665233 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-ff0c5505-9d8c-442c-8a54-d9dcc30cb689 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:12:48.671297 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ff0c5505-9d8c-442c-8a54-d9dcc30cb689 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:48.671740 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ff0c5505-9d8c-442c-8a54-d9dcc30cb689 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:48.673010 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ff0c5505-9d8c-442c-8a54-d9dcc30cb689 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:48.673447 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ff0c5505-9d8c-442c-8a54-d9dcc30cb689 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:48.803919 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-ff0c5505-9d8c-442c-8a54-d9dcc30cb689 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:48.812177 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-ff0c5505-9d8c-442c-8a54-d9dcc30cb689 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:48.814429 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-ff0c5505-9d8c-442c-8a54-d9dcc30cb689 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:48.815590 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-ff0c5505-9d8c-442c-8a54-d9dcc30cb689 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1726 microversion: 2.20 time: 0.155081 May 31 21:12:48.816148 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 447/918] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:12:48 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 21:12:49.573025 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-38866009-1674-437c-9ae3-a0753a7a15a3 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "POST /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 11.870896 May 31 21:12:49.573649 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 472/919] 10.222.0.55 () {60 vars in 1322 bytes} [Tue May 31 21:12:37 2022] POST /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525/os-volume_attachments => generated 194 bytes in 11872 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:12:49.833968 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-15e17b86-902d-4729-a392-b3541e986fc1 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:12:49.834587 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-15e17b86-902d-4729-a392-b3541e986fc1 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:12:49.840978 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-15e17b86-902d-4729-a392-b3541e986fc1 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:49.841468 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-15e17b86-902d-4729-a392-b3541e986fc1 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:49.842265 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-15e17b86-902d-4729-a392-b3541e986fc1 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:49.842727 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-15e17b86-902d-4729-a392-b3541e986fc1 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:49.970307 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-15e17b86-902d-4729-a392-b3541e986fc1 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:49.978309 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-15e17b86-902d-4729-a392-b3541e986fc1 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:49.979821 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-15e17b86-902d-4729-a392-b3541e986fc1 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:49.980965 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-15e17b86-902d-4729-a392-b3541e986fc1 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1726 microversion: 2.20 time: 0.151167 May 31 21:12:49.981520 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 448/920] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:12:49 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:12:50.999926 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-6d791827-a9ef-4f76-9a65-a329cb166739 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:12:51.000612 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-6d791827-a9ef-4f76-9a65-a329cb166739 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:12:51.006856 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6d791827-a9ef-4f76-9a65-a329cb166739 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:51.007302 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6d791827-a9ef-4f76-9a65-a329cb166739 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:51.008056 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6d791827-a9ef-4f76-9a65-a329cb166739 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:51.008487 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6d791827-a9ef-4f76-9a65-a329cb166739 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:51.140260 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-6d791827-a9ef-4f76-9a65-a329cb166739 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:51.148859 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-6d791827-a9ef-4f76-9a65-a329cb166739 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:51.150447 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-6d791827-a9ef-4f76-9a65-a329cb166739 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:51.151595 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-6d791827-a9ef-4f76-9a65-a329cb166739 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1726 microversion: 2.20 time: 0.156388 May 31 21:12:51.152158 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 473/921] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:12:50 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:12:52.169732 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-3d426ef6-bf91-45c4-9e72-abfab72dcbd8 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:12:52.170384 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-3d426ef6-bf91-45c4-9e72-abfab72dcbd8 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:12:52.176927 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-3d426ef6-bf91-45c4-9e72-abfab72dcbd8 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:52.177397 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-3d426ef6-bf91-45c4-9e72-abfab72dcbd8 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:52.178181 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-3d426ef6-bf91-45c4-9e72-abfab72dcbd8 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:52.178753 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-3d426ef6-bf91-45c4-9e72-abfab72dcbd8 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:52.317398 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-3d426ef6-bf91-45c4-9e72-abfab72dcbd8 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:52.325427 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-3d426ef6-bf91-45c4-9e72-abfab72dcbd8 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:52.326963 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-3d426ef6-bf91-45c4-9e72-abfab72dcbd8 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:52.328119 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-3d426ef6-bf91-45c4-9e72-abfab72dcbd8 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1726 microversion: 2.20 time: 0.162320 May 31 21:12:52.328688 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 449/922] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:12:52 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:12:53.210353 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [req-b495f734-e1d0-4131-8d84-dc7f41af5a48 req-db2869ab-cc40-4483-a609-616a964fc488 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d316a51-73db-479f-8449-ab51b42548e4", "name": "network-vif-plugged", "status": "completed", "tag": "ad3164a5-db8a-4332-a6c0-bcd7015cabda"}]} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:12:53.218828 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-b495f734-e1d0-4131-8d84-dc7f41af5a48 req-db2869ab-cc40-4483-a609-616a964fc488 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:53.219273 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-b495f734-e1d0-4131-8d84-dc7f41af5a48 req-db2869ab-cc40-4483-a609-616a964fc488 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:53.232201 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.compute.server_external_events [req-b495f734-e1d0-4131-8d84-dc7f41af5a48 req-db2869ab-cc40-4483-a609-616a964fc488 service nova] Creating event network-vif-plugged:ad3164a5-db8a-4332-a6c0-bcd7015cabda for instance 1d316a51-73db-479f-8449-ab51b42548e4 on hv-cinder-83979 May 31 21:12:53.237948 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [req-b495f734-e1d0-4131-8d84-dc7f41af5a48 req-db2869ab-cc40-4483-a609-616a964fc488 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031501 May 31 21:12:53.238650 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 474/923] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:12:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:12:53.346312 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-a0a650d3-77f4-43f6-9ef5-377ac0d9f853 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:12:53.346957 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-a0a650d3-77f4-43f6-9ef5-377ac0d9f853 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:12:53.353561 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a0a650d3-77f4-43f6-9ef5-377ac0d9f853 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:53.354065 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a0a650d3-77f4-43f6-9ef5-377ac0d9f853 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:53.354842 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a0a650d3-77f4-43f6-9ef5-377ac0d9f853 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:53.355283 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a0a650d3-77f4-43f6-9ef5-377ac0d9f853 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:53.486234 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-a0a650d3-77f4-43f6-9ef5-377ac0d9f853 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:53.494740 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-a0a650d3-77f4-43f6-9ef5-377ac0d9f853 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:53.496826 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-a0a650d3-77f4-43f6-9ef5-377ac0d9f853 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:53.498046 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-a0a650d3-77f4-43f6-9ef5-377ac0d9f853 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1726 microversion: 2.20 time: 0.155652 May 31 21:12:53.498935 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 450/924] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:12:53 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:12:54.518224 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-da77af33-88ab-4d84-90b6-36783d130ff9 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:12:54.518909 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-da77af33-88ab-4d84-90b6-36783d130ff9 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:12:54.525112 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-da77af33-88ab-4d84-90b6-36783d130ff9 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:54.525555 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-da77af33-88ab-4d84-90b6-36783d130ff9 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:54.526343 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-da77af33-88ab-4d84-90b6-36783d130ff9 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:54.526772 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-da77af33-88ab-4d84-90b6-36783d130ff9 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:54.657858 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-da77af33-88ab-4d84-90b6-36783d130ff9 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:54.666046 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-da77af33-88ab-4d84-90b6-36783d130ff9 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:54.667553 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-da77af33-88ab-4d84-90b6-36783d130ff9 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:54.668712 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-da77af33-88ab-4d84-90b6-36783d130ff9 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1726 microversion: 2.20 time: 0.155795 May 31 21:12:54.669269 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 475/925] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:12:54 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:12:55.687858 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-4a3c4a77-0564-4ee8-84df-47baac3a6f99 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:12:55.688540 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-4a3c4a77-0564-4ee8-84df-47baac3a6f99 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:12:55.696080 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4a3c4a77-0564-4ee8-84df-47baac3a6f99 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:55.696669 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4a3c4a77-0564-4ee8-84df-47baac3a6f99 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:55.697446 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4a3c4a77-0564-4ee8-84df-47baac3a6f99 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:55.697882 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4a3c4a77-0564-4ee8-84df-47baac3a6f99 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:55.830268 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-4a3c4a77-0564-4ee8-84df-47baac3a6f99 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:55.838536 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-4a3c4a77-0564-4ee8-84df-47baac3a6f99 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:55.840026 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-4a3c4a77-0564-4ee8-84df-47baac3a6f99 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:55.841167 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-4a3c4a77-0564-4ee8-84df-47baac3a6f99 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1726 microversion: 2.20 time: 0.157993 May 31 21:12:55.841723 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 451/926] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:12:55 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:12:56.859182 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-b54bb06f-1f11-4483-9385-acf07f092756 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:12:56.859701 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-b54bb06f-1f11-4483-9385-acf07f092756 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:12:56.866214 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b54bb06f-1f11-4483-9385-acf07f092756 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:56.867108 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b54bb06f-1f11-4483-9385-acf07f092756 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:56.867410 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b54bb06f-1f11-4483-9385-acf07f092756 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:56.867843 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b54bb06f-1f11-4483-9385-acf07f092756 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:57.006015 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-b54bb06f-1f11-4483-9385-acf07f092756 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:57.022910 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-b54bb06f-1f11-4483-9385-acf07f092756 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:57.024566 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-b54bb06f-1f11-4483-9385-acf07f092756 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:57.025840 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-b54bb06f-1f11-4483-9385-acf07f092756 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1726 microversion: 2.20 time: 0.170537 May 31 21:12:57.030391 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 476/927] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:12:56 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1726 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:12:57.093177 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-fce953bc-a033-4eee-ab59-126e3f49f7cf tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:12:57.094406 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-fce953bc-a033-4eee-ab59-126e3f49f7cf tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: e26c2265-9a33-4c2a-9e41-6bf685f4c525] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:12:57.097330 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_api:SELECT=46 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:12:57.102146 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-fce953bc-a033-4eee-ab59-126e3f49f7cf tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:57.102597 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-fce953bc-a033-4eee-ab59-126e3f49f7cf tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:57.103361 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-fce953bc-a033-4eee-ab59-126e3f49f7cf tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:57.103793 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-fce953bc-a033-4eee-ab59-126e3f49f7cf tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:57.133351 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-fce953bc-a033-4eee-ab59-126e3f49f7cf tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044054 May 31 21:12:57.133829 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 452/928] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 31 21:12:57 2022] GET /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:12:57.144286 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-92deff2c-ad37-4dc1-b5e2-c58e4895b6f9 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:12:57.144803 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-92deff2c-ad37-4dc1-b5e2-c58e4895b6f9 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: e26c2265-9a33-4c2a-9e41-6bf685f4c525] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:12:57.151101 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-92deff2c-ad37-4dc1-b5e2-c58e4895b6f9 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:57.151547 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-92deff2c-ad37-4dc1-b5e2-c58e4895b6f9 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:57.152309 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-92deff2c-ad37-4dc1-b5e2-c58e4895b6f9 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:57.152741 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-92deff2c-ad37-4dc1-b5e2-c58e4895b6f9 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:57.181605 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-92deff2c-ad37-4dc1-b5e2-c58e4895b6f9 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525/os-volume_attachments/21d31bf3-1820-490d-a69a-a8a6d9ec7abe" status: 200 len: 194 microversion: 2.1 time: 0.041851 May 31 21:12:57.182227 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 477/929] 10.222.0.55 () {58 vars in 1412 bytes} [Tue May 31 21:12:57 2022] GET /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525/os-volume_attachments/21d31bf3-1820-490d-a69a-a8a6d9ec7abe => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:12:58.047577 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-42f62a6b-1a5a-4685-9c58-b335286a5768 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:12:58.048732 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-42f62a6b-1a5a-4685-9c58-b335286a5768 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:12:58.055334 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-42f62a6b-1a5a-4685-9c58-b335286a5768 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:58.055782 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-42f62a6b-1a5a-4685-9c58-b335286a5768 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:58.056541 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-42f62a6b-1a5a-4685-9c58-b335286a5768 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:58.056998 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-42f62a6b-1a5a-4685-9c58-b335286a5768 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:58.183287 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-42f62a6b-1a5a-4685-9c58-b335286a5768 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:58.192215 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-42f62a6b-1a5a-4685-9c58-b335286a5768 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:58.193728 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-42f62a6b-1a5a-4685-9c58-b335286a5768 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:12:58.194914 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-42f62a6b-1a5a-4685-9c58-b335286a5768 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1713 microversion: 2.20 time: 0.151412 May 31 21:12:58.195471 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 453/930] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:12:58 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1713 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:12:58.862512 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-1a81e5b6-ffb3-4b34-9259-28e78a446142 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bc4dc829-df1d-4ba3-90d4-a1688c80be85"}} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:12:58.863611 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-1a81e5b6-ffb3-4b34-9259-28e78a446142 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: e26c2265-9a33-4c2a-9e41-6bf685f4c525] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:12:58.870180 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-1a81e5b6-ffb3-4b34-9259-28e78a446142 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:58.870629 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-1a81e5b6-ffb3-4b34-9259-28e78a446142 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:58.871396 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-1a81e5b6-ffb3-4b34-9259-28e78a446142 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:12:58.871832 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-1a81e5b6-ffb3-4b34-9259-28e78a446142 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:12:59.556148 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-1a81e5b6-ffb3-4b34-9259-28e78a446142 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "POST /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.698542 May 31 21:12:59.556773 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 478/931] 10.222.0.55 () {60 vars in 1322 bytes} [Tue May 31 21:12:58 2022] POST /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525/os-volume_attachments => generated 194 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:13:08.090867 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-108557bc-011e-4d70-a750-fc5d44033326 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:13:08.091785 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-108557bc-011e-4d70-a750-fc5d44033326 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: e26c2265-9a33-4c2a-9e41-6bf685f4c525] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:13:08.094264 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_api:SELECT=3 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:13:08.099605 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-108557bc-011e-4d70-a750-fc5d44033326 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:08.100054 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-108557bc-011e-4d70-a750-fc5d44033326 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:08.100823 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-108557bc-011e-4d70-a750-fc5d44033326 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:08.101301 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-108557bc-011e-4d70-a750-fc5d44033326 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:08.131580 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-108557bc-011e-4d70-a750-fc5d44033326 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044574 May 31 21:13:08.132138 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 454/932] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 31 21:13:08 2022] GET /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:13:08.261080 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-c4f766c7-5f92-4154-a19b-f731d61c4ceb tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:13:08.261646 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-c4f766c7-5f92-4154-a19b-f731d61c4ceb tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 5cb669a7-8e63-46ac-86f6-1be4050a44ec] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:13:08.268688 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c4f766c7-5f92-4154-a19b-f731d61c4ceb tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:08.269071 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c4f766c7-5f92-4154-a19b-f731d61c4ceb tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:08.269844 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c4f766c7-5f92-4154-a19b-f731d61c4ceb tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:08.270298 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c4f766c7-5f92-4154-a19b-f731d61c4ceb tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:08.272176 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-4580063c-4fda-43c1-b875-11c496edefa3 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:13:08.272814 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-4580063c-4fda-43c1-b875-11c496edefa3 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: e26c2265-9a33-4c2a-9e41-6bf685f4c525] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:13:08.278921 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4580063c-4fda-43c1-b875-11c496edefa3 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:08.279373 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4580063c-4fda-43c1-b875-11c496edefa3 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:08.280145 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4580063c-4fda-43c1-b875-11c496edefa3 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:08.280588 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4580063c-4fda-43c1-b875-11c496edefa3 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:08.294348 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-c4f766c7-5f92-4154-a19b-f731d61c4ceb tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec/ips" status: 200 len: 150 microversion: 2.1 time: 0.038049 May 31 21:13:08.294931 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 479/933] 10.222.0.55 () {58 vars in 1247 bytes} [Tue May 31 21:13:08 2022] GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:13:08.310214 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-4580063c-4fda-43c1-b875-11c496edefa3 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525/os-volume_attachments/21d31bf3-1820-490d-a69a-a8a6d9ec7abe" status: 200 len: 194 microversion: 2.1 time: 0.042706 May 31 21:13:08.310811 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 455/934] 10.222.0.55 () {58 vars in 1412 bytes} [Tue May 31 21:13:08 2022] GET /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525/os-volume_attachments/21d31bf3-1820-490d-a69a-a8a6d9ec7abe => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 21:13:08.320282 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-f530cfb6-6951-4a9f-b969-fd8e6f2ac1fa tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:13:08.320767 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-f530cfb6-6951-4a9f-b969-fd8e6f2ac1fa tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: e26c2265-9a33-4c2a-9e41-6bf685f4c525] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:13:08.326751 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f530cfb6-6951-4a9f-b969-fd8e6f2ac1fa tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:08.327196 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f530cfb6-6951-4a9f-b969-fd8e6f2ac1fa tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:08.327943 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f530cfb6-6951-4a9f-b969-fd8e6f2ac1fa tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:08.328372 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f530cfb6-6951-4a9f-b969-fd8e6f2ac1fa tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:08.409011 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.objects.instance [None req-f530cfb6-6951-4a9f-b969-fd8e6f2ac1fa tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lazy-loading 'services' on Instance uuid e26c2265-9a33-4c2a-9e41-6bf685f4c525 {{(pid=118184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 21:13:08.661259 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-f530cfb6-6951-4a9f-b969-fd8e6f2ac1fa tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "DELETE /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525/os-volume_attachments/21d31bf3-1820-490d-a69a-a8a6d9ec7abe" status: 202 len: 0 microversion: 2.1 time: 0.344662 May 31 21:13:08.661982 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 480/935] 10.222.0.55 () {58 vars in 1415 bytes} [Tue May 31 21:13:08 2022] DELETE /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525/os-volume_attachments/21d31bf3-1820-490d-a69a-a8a6d9ec7abe => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 21:13:09.946587 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-19363122-b5ba-4725-8307-518e9e7f7851 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "06c97b8d-40ba-4efc-baba-bc7096f3aa63"}} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:13:09.947740 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-19363122-b5ba-4725-8307-518e9e7f7851 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 5cb669a7-8e63-46ac-86f6-1be4050a44ec] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:13:09.954031 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-19363122-b5ba-4725-8307-518e9e7f7851 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:09.954479 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-19363122-b5ba-4725-8307-518e9e7f7851 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:09.955238 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-19363122-b5ba-4725-8307-518e9e7f7851 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:09.955668 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-19363122-b5ba-4725-8307-518e9e7f7851 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:10.025546 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell1:SELECT=100 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:13:10.703771 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-19363122-b5ba-4725-8307-518e9e7f7851 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "POST /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.760896 May 31 21:13:10.704391 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 456/936] 10.222.0.55 () {60 vars in 1322 bytes} [Tue May 31 21:13:09 2022] POST /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec/os-volume_attachments => generated 194 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:13:10.824824 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-ca77c740-d3e5-418a-a333-4a748f84a693 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:13:10.825399 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-ca77c740-d3e5-418a-a333-4a748f84a693 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: e26c2265-9a33-4c2a-9e41-6bf685f4c525] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:13:10.832598 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ca77c740-d3e5-418a-a333-4a748f84a693 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:10.833048 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ca77c740-d3e5-418a-a333-4a748f84a693 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:10.833814 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ca77c740-d3e5-418a-a333-4a748f84a693 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:10.834368 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ca77c740-d3e5-418a-a333-4a748f84a693 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:10.862313 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-ca77c740-d3e5-418a-a333-4a748f84a693 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525/os-volume_attachments/bc4dc829-df1d-4ba3-90d4-a1688c80be85" status: 200 len: 194 microversion: 2.1 time: 0.042516 May 31 21:13:10.862897 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 481/937] 10.222.0.55 () {58 vars in 1412 bytes} [Tue May 31 21:13:10 2022] GET /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525/os-volume_attachments/bc4dc829-df1d-4ba3-90d4-a1688c80be85 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:13:10.873513 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-cd58298b-e194-41ec-9088-e3606cf7ec52 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:13:10.874186 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-cd58298b-e194-41ec-9088-e3606cf7ec52 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: e26c2265-9a33-4c2a-9e41-6bf685f4c525] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:13:10.881107 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-cd58298b-e194-41ec-9088-e3606cf7ec52 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:10.881557 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-cd58298b-e194-41ec-9088-e3606cf7ec52 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:10.882358 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-cd58298b-e194-41ec-9088-e3606cf7ec52 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:10.882797 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-cd58298b-e194-41ec-9088-e3606cf7ec52 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:10.968129 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.objects.instance [None req-cd58298b-e194-41ec-9088-e3606cf7ec52 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lazy-loading 'services' on Instance uuid e26c2265-9a33-4c2a-9e41-6bf685f4c525 {{(pid=118185) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 21:13:11.182487 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-cd58298b-e194-41ec-9088-e3606cf7ec52 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "DELETE /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525/os-volume_attachments/bc4dc829-df1d-4ba3-90d4-a1688c80be85" status: 202 len: 0 microversion: 2.1 time: 0.312943 May 31 21:13:11.183162 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 457/938] 10.222.0.55 () {58 vars in 1415 bytes} [Tue May 31 21:13:10 2022] DELETE /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525/os-volume_attachments/bc4dc829-df1d-4ba3-90d4-a1688c80be85 => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 21:13:18.191555 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-0b65cb11-b06a-4846-a194-2dc912130ebe tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Action: 'create', calling method: .version_select at 0x7fe7c0bfd310>, body: {"keypair": {"name": "tempest-keypair-1447715153", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/Y5pGLC7S9JBSlaCOwkjtL+4OrljJnVWIelWXckk2usk8UghPIEhxM7UczOsY1AwXwHC/C834+dzHJ14i85brxS1l5AWmta466gB1ueKajv88C80bdbm7wCZAYLXxCcQ=="}} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:13:18.196113 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_api:SELECT=19 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:13:18.206984 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.quota [None req-0b65cb11-b06a-4846-a194-2dc912130ebe tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Getting quotas for project 69b2364f40d14160adf0220d92adaad7. Resources: {'key_pairs'} {{(pid=118184) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 21:13:18.210761 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.quota [None req-0b65cb11-b06a-4846-a194-2dc912130ebe tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Getting quotas for user 8efe37a6d57b4775b4e47a295c3f5eee and project 69b2364f40d14160adf0220d92adaad7. Resources: {'key_pairs'} {{(pid=118184) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 21:13:18.326022 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-0b65cb11-b06a-4846-a194-2dc912130ebe tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.138213 May 31 21:13:18.326718 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 482/939] 10.222.0.55 () {60 vars in 1158 bytes} [Tue May 31 21:13:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:13:19.726836 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-47cc6461-bd00-490b-b1c4-e25c86989eec tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:13:19.727904 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-47cc6461-bd00-490b-b1c4-e25c86989eec tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: e26c2265-9a33-4c2a-9e41-6bf685f4c525] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:13:19.735317 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-47cc6461-bd00-490b-b1c4-e25c86989eec tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:19.735766 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-47cc6461-bd00-490b-b1c4-e25c86989eec tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:19.736535 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-47cc6461-bd00-490b-b1c4-e25c86989eec tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:19.736971 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-47cc6461-bd00-490b-b1c4-e25c86989eec tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:19.766568 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-47cc6461-bd00-490b-b1c4-e25c86989eec tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044145 May 31 21:13:19.767135 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 458/940] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 31 21:13:19 2022] GET /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 31 21:13:19.895788 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-55bd52c1-9605-4336-a2b6-f70b3f958100 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:13:19.896869 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-55bd52c1-9605-4336-a2b6-f70b3f958100 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: e26c2265-9a33-4c2a-9e41-6bf685f4c525] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:13:19.905820 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-55bd52c1-9605-4336-a2b6-f70b3f958100 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:19.906294 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-55bd52c1-9605-4336-a2b6-f70b3f958100 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:19.907129 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-55bd52c1-9605-4336-a2b6-f70b3f958100 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:19.907635 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-55bd52c1-9605-4336-a2b6-f70b3f958100 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:19.911531 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:13:19.938027 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-55bd52c1-9605-4336-a2b6-f70b3f958100 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047535 May 31 21:13:19.938027 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 483/941] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 31 21:13:19 2022] GET /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 31 21:13:20.000317 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-a2e657d7-4143-40ff-8e89-81780de7e873 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:13:20.000815 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-a2e657d7-4143-40ff-8e89-81780de7e873 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: e26c2265-9a33-4c2a-9e41-6bf685f4c525] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:13:20.007820 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a2e657d7-4143-40ff-8e89-81780de7e873 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:20.008216 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a2e657d7-4143-40ff-8e89-81780de7e873 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:20.008996 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a2e657d7-4143-40ff-8e89-81780de7e873 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:20.009436 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a2e657d7-4143-40ff-8e89-81780de7e873 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:20.037722 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-a2e657d7-4143-40ff-8e89-81780de7e873 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: e26c2265-9a33-4c2a-9e41-6bf685f4c525] Going to try to terminate instance {{(pid=118185) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 21:13:20.358784 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-a2e657d7-4143-40ff-8e89-81780de7e873 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "DELETE /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525" status: 204 len: 0 microversion: 2.1 time: 0.362034 May 31 21:13:20.359371 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 459/942] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 31 21:13:19 2022] DELETE /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 31 21:13:20.368562 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-00620bb5-1391-4cef-9966-02f4f615203b tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:13:20.369166 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-00620bb5-1391-4cef-9966-02f4f615203b tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: e26c2265-9a33-4c2a-9e41-6bf685f4c525] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:13:20.375474 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-00620bb5-1391-4cef-9966-02f4f615203b tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:20.375916 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-00620bb5-1391-4cef-9966-02f4f615203b tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:20.376673 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-00620bb5-1391-4cef-9966-02f4f615203b tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:20.377102 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-00620bb5-1391-4cef-9966-02f4f615203b tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:20.470297 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-f2ddc3fa-7cf9-4d8d-86fc-dac733229d82 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-78209009", "imageRef": "21b89996-9e87-489d-8891-305f6c3d905a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f9f27def-cef7-45b6-9a7b-b0c954078818"}], "security_groups": [{"name": "tempest-securitygroup--1332355222"}], "key_name": "tempest-keypair-1447715153", "user_data": "}} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:13:20.560137 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-00620bb5-1391-4cef-9966-02f4f615203b tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:13:20.567763 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-00620bb5-1391-4cef-9966-02f4f615203b tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525" status: 200 len: 1672 microversion: 2.1 time: 0.203429 May 31 21:13:20.568500 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 484/943] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:13:20 2022] GET /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525 => generated 1672 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:13:20.673033 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.network.neutron [None req-f2ddc3fa-7cf9-4d8d-86fc-dac733229d82 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] validate_networks() for [('f9f27def-cef7-45b6-9a7b-b0c954078818', None, None, None, None, None)] {{(pid=118185) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 21:13:21.032515 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.virt.hardware [None req-f2ddc3fa-7cf9-4d8d-86fc-dac733229d82 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Flavor limits 0:0:0 {{(pid=118185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 21:13:21.033085 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.virt.hardware [None req-f2ddc3fa-7cf9-4d8d-86fc-dac733229d82 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Image limits 0:0:0 {{(pid=118185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 21:13:21.033413 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.virt.hardware [None req-f2ddc3fa-7cf9-4d8d-86fc-dac733229d82 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Flavor pref 0:0:0 {{(pid=118185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 21:13:21.033952 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.virt.hardware [None req-f2ddc3fa-7cf9-4d8d-86fc-dac733229d82 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Image pref 0:0:0 {{(pid=118185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 21:13:21.034931 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.virt.hardware [None req-f2ddc3fa-7cf9-4d8d-86fc-dac733229d82 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 21:13:21.043866 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f2ddc3fa-7cf9-4d8d-86fc-dac733229d82 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:21.044316 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f2ddc3fa-7cf9-4d8d-86fc-dac733229d82 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:21.045126 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f2ddc3fa-7cf9-4d8d-86fc-dac733229d82 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:21.045562 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f2ddc3fa-7cf9-4d8d-86fc-dac733229d82 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:21.061847 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.quota [None req-f2ddc3fa-7cf9-4d8d-86fc-dac733229d82 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Getting quotas for project 69b2364f40d14160adf0220d92adaad7. Resources: {'ram', 'cores', 'instances'} {{(pid=118185) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 21:13:21.066296 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.quota [None req-f2ddc3fa-7cf9-4d8d-86fc-dac733229d82 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Getting quotas for user 8efe37a6d57b4775b4e47a295c3f5eee and project 69b2364f40d14160adf0220d92adaad7. Resources: {'ram', 'cores', 'instances'} {{(pid=118185) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 21:13:21.077238 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-f2ddc3fa-7cf9-4d8d-86fc-dac733229d82 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Going to run 1 instances... {{(pid=118185) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 21:13:21.079612 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-f2ddc3fa-7cf9-4d8d-86fc-dac733229d82 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='21b89996-9e87-489d-8891-305f6c3d905a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118185) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 21:13:21.246185 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-f2ddc3fa-7cf9-4d8d-86fc-dac733229d82 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.780553 May 31 21:13:21.246838 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 460/944] 10.222.0.55 () {60 vars in 1146 bytes} [Tue May 31 21:13:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 31 21:13:21.257794 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-23c15e28-b5b2-4746-8b4d-25dfa8b81174 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:13:21.258428 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-23c15e28-b5b2-4746-8b4d-25dfa8b81174 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:13:21.312362 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-23c15e28-b5b2-4746-8b4d-25dfa8b81174 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe37a6d57b4775b4e47a295c3f5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b2364f40d14160adf0220d92adaad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:13:21.319701 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-23c15e28-b5b2-4746-8b4d-25dfa8b81174 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982" status: 200 len: 1240 microversion: 2.1 time: 0.066723 May 31 21:13:21.320274 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 485/945] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:13:21 2022] GET /compute/v2.1/servers/5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982 => generated 1240 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:13:21.585687 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-4d644ab4-6504-4bc3-bf0e-df914c1c5ff1 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:13:21.586401 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-4d644ab4-6504-4bc3-bf0e-df914c1c5ff1 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: e26c2265-9a33-4c2a-9e41-6bf685f4c525] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:13:21.593457 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4d644ab4-6504-4bc3-bf0e-df914c1c5ff1 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:21.593936 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4d644ab4-6504-4bc3-bf0e-df914c1c5ff1 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:21.594724 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4d644ab4-6504-4bc3-bf0e-df914c1c5ff1 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:21.595167 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4d644ab4-6504-4bc3-bf0e-df914c1c5ff1 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:21.729316 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-4d644ab4-6504-4bc3-bf0e-df914c1c5ff1 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:13:21.737807 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-4d644ab4-6504-4bc3-bf0e-df914c1c5ff1 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525" status: 200 len: 1672 microversion: 2.1 time: 0.156407 May 31 21:13:21.738620 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 461/946] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:13:21 2022] GET /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525 => generated 1672 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:13:22.338276 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-052827ee-705d-4a0e-a012-79674fc19c3c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:13:22.338890 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-052827ee-705d-4a0e-a012-79674fc19c3c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:13:22.347682 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-052827ee-705d-4a0e-a012-79674fc19c3c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:22.348133 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-052827ee-705d-4a0e-a012-79674fc19c3c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:22.348917 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-052827ee-705d-4a0e-a012-79674fc19c3c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:22.349394 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-052827ee-705d-4a0e-a012-79674fc19c3c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:22.410645 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-052827ee-705d-4a0e-a012-79674fc19c3c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe37a6d57b4775b4e47a295c3f5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b2364f40d14160adf0220d92adaad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:13:22.419148 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-052827ee-705d-4a0e-a012-79674fc19c3c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982" status: 200 len: 1244 microversion: 2.1 time: 0.085235 May 31 21:13:22.422087 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 486/947] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:13:22 2022] GET /compute/v2.1/servers/5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982 => generated 1244 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:13:22.755537 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-7485b3ab-11b6-45a3-b593-7744df2fb224 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:13:22.756132 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-7485b3ab-11b6-45a3-b593-7744df2fb224 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: e26c2265-9a33-4c2a-9e41-6bf685f4c525] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:13:22.762619 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-7485b3ab-11b6-45a3-b593-7744df2fb224 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:22.763081 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-7485b3ab-11b6-45a3-b593-7744df2fb224 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:22.763864 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-7485b3ab-11b6-45a3-b593-7744df2fb224 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:22.764306 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-7485b3ab-11b6-45a3-b593-7744df2fb224 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:22.901128 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-7485b3ab-11b6-45a3-b593-7744df2fb224 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:13:22.909138 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-7485b3ab-11b6-45a3-b593-7744df2fb224 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525" status: 200 len: 1672 microversion: 2.1 time: 0.157721 May 31 21:13:22.910100 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 462/948] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:13:22 2022] GET /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525 => generated 1672 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:13:23.436862 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-d2bd6594-5f57-4eed-881b-f19e3ae13e11 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:13:23.437544 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-d2bd6594-5f57-4eed-881b-f19e3ae13e11 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:13:23.444896 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d2bd6594-5f57-4eed-881b-f19e3ae13e11 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:23.445435 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d2bd6594-5f57-4eed-881b-f19e3ae13e11 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:23.446335 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d2bd6594-5f57-4eed-881b-f19e3ae13e11 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:23.446834 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d2bd6594-5f57-4eed-881b-f19e3ae13e11 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:23.537516 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-d2bd6594-5f57-4eed-881b-f19e3ae13e11 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe37a6d57b4775b4e47a295c3f5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b2364f40d14160adf0220d92adaad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:13:23.548347 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-d2bd6594-5f57-4eed-881b-f19e3ae13e11 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982" status: 200 len: 1310 microversion: 2.1 time: 0.115332 May 31 21:13:23.559710 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 487/949] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:13:23 2022] GET /compute/v2.1/servers/5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982 => generated 1310 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:13:23.598847 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [req-8ff25742-4a00-45b8-b8c6-a956bc2f2d1b req-9206f7df-481a-47c1-a9a5-f8d6a93077c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e26c2265-9a33-4c2a-9e41-6bf685f4c525", "name": "network-vif-deleted", "tag": "04ab265f-077c-4c29-bea4-68787d93131b"}]} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:13:23.608248 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-8ff25742-4a00-45b8-b8c6-a956bc2f2d1b req-9206f7df-481a-47c1-a9a5-f8d6a93077c5 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:23.609023 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-8ff25742-4a00-45b8-b8c6-a956bc2f2d1b req-9206f7df-481a-47c1-a9a5-f8d6a93077c5 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:23.622537 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.compute.server_external_events [req-8ff25742-4a00-45b8-b8c6-a956bc2f2d1b req-9206f7df-481a-47c1-a9a5-f8d6a93077c5 service nova] Creating event network-vif-deleted:04ab265f-077c-4c29-bea4-68787d93131b for instance e26c2265-9a33-4c2a-9e41-6bf685f4c525 on hv-cinder-83979 May 31 21:13:23.629035 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [req-8ff25742-4a00-45b8-b8c6-a956bc2f2d1b req-9206f7df-481a-47c1-a9a5-f8d6a93077c5 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034999 May 31 21:13:23.630188 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 463/950] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:13:23.927142 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-7ec6f823-da59-4bd0-9791-7e23d592a8d4 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:13:23.928122 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-7ec6f823-da59-4bd0-9791-7e23d592a8d4 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: e26c2265-9a33-4c2a-9e41-6bf685f4c525] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:13:23.934914 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7ec6f823-da59-4bd0-9791-7e23d592a8d4 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:23.939146 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7ec6f823-da59-4bd0-9791-7e23d592a8d4 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:23.939146 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7ec6f823-da59-4bd0-9791-7e23d592a8d4 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:23.939146 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7ec6f823-da59-4bd0-9791-7e23d592a8d4 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:23.972390 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7ec6f823-da59-4bd0-9791-7e23d592a8d4 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:23.973101 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7ec6f823-da59-4bd0-9791-7e23d592a8d4 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:23.973578 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.objects.instance [None req-7ec6f823-da59-4bd0-9791-7e23d592a8d4 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lazy-loading 'fault' on Instance uuid e26c2265-9a33-4c2a-9e41-6bf685f4c525 {{(pid=118184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 21:13:24.015429 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-7ec6f823-da59-4bd0-9791-7e23d592a8d4 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d56ad8d4ab4c1099263a3d1c43490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180ff6fd8c5b434abffa058ea99ef7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:13:24.025187 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-7ec6f823-da59-4bd0-9791-7e23d592a8d4 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525" status: 200 len: 1327 microversion: 2.1 time: 0.101137 May 31 21:13:24.025187 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 488/951] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:13:23 2022] GET /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525 => generated 1327 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:13:24.571144 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-da579c03-ec21-4eb7-a698-55f40c0391ca tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:13:24.572634 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-da579c03-ec21-4eb7-a698-55f40c0391ca tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:13:24.580437 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-da579c03-ec21-4eb7-a698-55f40c0391ca tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:24.581921 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-da579c03-ec21-4eb7-a698-55f40c0391ca tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:24.582827 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-da579c03-ec21-4eb7-a698-55f40c0391ca tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:24.583342 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-da579c03-ec21-4eb7-a698-55f40c0391ca tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:24.726937 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-da579c03-ec21-4eb7-a698-55f40c0391ca tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe37a6d57b4775b4e47a295c3f5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b2364f40d14160adf0220d92adaad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:13:24.734531 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-da579c03-ec21-4eb7-a698-55f40c0391ca tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982" status: 200 len: 1366 microversion: 2.1 time: 0.167768 May 31 21:13:24.735222 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 464/952] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:13:24 2022] GET /compute/v2.1/servers/5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:13:25.040953 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-1b0d549b-d9c8-42dc-b4f4-06b5f6894d53 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:13:25.042251 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-1b0d549b-d9c8-42dc-b4f4-06b5f6894d53 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: e26c2265-9a33-4c2a-9e41-6bf685f4c525] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:13:25.049276 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-1b0d549b-d9c8-42dc-b4f4-06b5f6894d53 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:25.050043 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-1b0d549b-d9c8-42dc-b4f4-06b5f6894d53 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:25.051005 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-1b0d549b-d9c8-42dc-b4f4-06b5f6894d53 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:25.051594 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-1b0d549b-d9c8-42dc-b4f4-06b5f6894d53 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:25.067905 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.wsgi [None req-1b0d549b-d9c8-42dc-b4f4-06b5f6894d53 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] HTTP exception thrown: Instance e26c2265-9a33-4c2a-9e41-6bf685f4c525 could not be found. May 31 21:13:25.069996 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-1b0d549b-d9c8-42dc-b4f4-06b5f6894d53 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Request method failure captured: May 31 21:13:25.069996 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: request: GET /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525 HTTP/1.1 May 31 21:13:25.069996 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Accept: application/json May 31 21:13:25.069996 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Accept-Encoding: identity May 31 21:13:25.069996 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Connection: close May 31 21:13:25.069996 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Content-Length: 0 May 31 21:13:25.069996 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Content-Type: application/json May 31 21:13:25.069996 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Host: 10.222.0.55 May 31 21:13:25.069996 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Openstack-System-Scope: None May 31 21:13:25.069996 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: User-Agent: python-urllib3/1.26.9 May 31 21:13:25.069996 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Auth-Token: gAAAAABiloKlkZoew85L1TdCmvO0RFP1xR5mXT6X2xEUB88pFhrUEE8uhof8Swf6MYZG3U_Q9b3Ivpfr-tfaWezatCne581AbmNbIqsdiz5siTPedALRZj6Qi0G6LR9gf9wTw3iAO_L_Nittc_1-f3oOlHbRyr-NnMcGkWfji8-9-Ep-WPTa_vI May 31 21:13:25.069996 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Domain-Id: None May 31 21:13:25.069996 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Domain-Name: None May 31 21:13:25.069996 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Identity-Status: Confirmed May 31 21:13:25.069996 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Is-Admin-Project: True May 31 21:13:25.069996 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Domain-Id: default May 31 21:13:25.069996 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Domain-Name: Default May 31 21:13:25.069996 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Id: 180ff6fd8c5b434abffa058ea99ef7c4 May 31 21:13:25.069996 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Name: tempest-AttachVolumeTestJSON-47090901 May 31 21:13:25.069996 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Role: member,reader May 31 21:13:25.069996 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Roles: member,reader May 31 21:13:25.071584 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/180ff6fd8c5b434abffa058ea99ef7c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/180ff6fd8c5b434abffa058ea99ef7c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_180ff6fd8c5b434abffa058ea99ef7c4", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/180ff6fd8c5b434abffa058ea99ef7c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] May 31 21:13:25.071584 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant: tempest-AttachVolumeTestJSON-47090901 May 31 21:13:25.071584 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant-Id: 180ff6fd8c5b434abffa058ea99ef7c4 May 31 21:13:25.071584 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant-Name: tempest-AttachVolumeTestJSON-47090901 May 31 21:13:25.071584 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User: tempest-AttachVolumeTestJSON-47090901-project May 31 21:13:25.071584 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Domain-Id: default May 31 21:13:25.071584 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Domain-Name: Default May 31 21:13:25.071584 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Id: 92d56ad8d4ab4c1099263a3d1c43490a May 31 21:13:25.071584 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Name: tempest-AttachVolumeTestJSON-47090901-project May 31 21:13:25.071584 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: method: > May 31 21:13:25.071584 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: exception: Instance e26c2265-9a33-4c2a-9e41-6bf685f4c525 could not be found. May 31 21:13:25.071584 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: action_args: {'id': 'e26c2265-9a33-4c2a-9e41-6bf685f4c525'} May 31 21:13:25.072456 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 21:13:25.072456 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:13:25.072456 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 21:13:25.072456 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 21:13:25.072456 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 21:13:25.072456 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 21:13:25.072456 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 21:13:25.072456 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 21:13:25.072456 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 21:13:25.072456 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 21:13:25.072456 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e26c2265-9a33-4c2a-9e41-6bf685f4c525 could not be found. May 31 21:13:25.072456 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:13:25.072456 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:13:25.072456 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:13:25.072456 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:13:25.072456 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:13:25.072456 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:13:25.072456 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 21:13:25.072456 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 21:13:25.072456 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 21:13:25.073906 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 21:13:25.073906 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 21:13:25.073906 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 21:13:25.073906 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 21:13:25.073906 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 21:13:25.073906 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 21:13:25.073906 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 21:13:25.073906 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e26c2265-9a33-4c2a-9e41-6bf685f4c525 could not be found. May 31 21:13:25.073906 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:13:25.073906 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:13:25.073906 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:13:25.073906 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:13:25.073906 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:13:25.073906 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:13:25.073906 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 21:13:25.073906 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 21:13:25.073906 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e26c2265-9a33-4c2a-9e41-6bf685f4c525 could not be found. May 31 21:13:25.073906 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:13:25.075863 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-1b0d549b-d9c8-42dc-b4f4-06b5f6894d53 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Returning 404 to user: Instance e26c2265-9a33-4c2a-9e41-6bf685f4c525 could not be found. {{(pid=118184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 21:13:25.076748 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-1b0d549b-d9c8-42dc-b4f4-06b5f6894d53 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525" status: 404 len: 111 microversion: 2.1 time: 0.039774 May 31 21:13:25.077285 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 489/953] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:13:25 2022] GET /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 21:13:25.088535 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-34084496-cd37-4a5a-92f3-47777dd234cd tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '.version_select at 0x7fe7c19563a0>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:13:25.205405 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-34084496-cd37-4a5a-92f3-47777dd234cd tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1672577644" status: 202 len: 0 microversion: 2.1 time: 0.122155 May 31 21:13:25.218047 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 465/954] 10.222.0.55 () {58 vars in 1220 bytes} [Tue May 31 21:13:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1672577644 => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 21:13:25.671301 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [req-6c18192f-4ad3-462b-950e-702fb6b37b2f req-c9e8a150-041f-4da7-847f-24627d822bac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982", "tag": "d2db5c87-efce-4692-aa2a-48540d4ccc40"}]} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:13:25.681096 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-6c18192f-4ad3-462b-950e-702fb6b37b2f req-c9e8a150-041f-4da7-847f-24627d822bac service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:25.681867 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-6c18192f-4ad3-462b-950e-702fb6b37b2f req-c9e8a150-041f-4da7-847f-24627d822bac service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:25.694960 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.compute.server_external_events [req-6c18192f-4ad3-462b-950e-702fb6b37b2f req-c9e8a150-041f-4da7-847f-24627d822bac service nova] Creating event network-changed:d2db5c87-efce-4692-aa2a-48540d4ccc40 for instance 5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982 on hv-cinder-83979 May 31 21:13:25.700403 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [req-6c18192f-4ad3-462b-950e-702fb6b37b2f req-c9e8a150-041f-4da7-847f-24627d822bac service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032827 May 31 21:13:25.701663 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 490/955] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:13:25.754438 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-9d606d6e-b5f5-4886-a299-7a35b74263cb tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:13:25.756401 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-9d606d6e-b5f5-4886-a299-7a35b74263cb tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:13:25.763676 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9d606d6e-b5f5-4886-a299-7a35b74263cb tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:25.765968 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9d606d6e-b5f5-4886-a299-7a35b74263cb tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:25.765968 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9d606d6e-b5f5-4886-a299-7a35b74263cb tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:25.765968 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9d606d6e-b5f5-4886-a299-7a35b74263cb tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:25.915635 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-9d606d6e-b5f5-4886-a299-7a35b74263cb tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe37a6d57b4775b4e47a295c3f5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b2364f40d14160adf0220d92adaad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:13:25.923094 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-9d606d6e-b5f5-4886-a299-7a35b74263cb tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982" status: 200 len: 1366 microversion: 2.1 time: 0.175444 May 31 21:13:25.923657 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 466/956] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:13:25 2022] GET /compute/v2.1/servers/5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982 => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:13:26.941210 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-a12f2a80-ddf7-4956-aa7e-f6243cf5fda5 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:13:26.941929 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-a12f2a80-ddf7-4956-aa7e-f6243cf5fda5 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:13:26.948199 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a12f2a80-ddf7-4956-aa7e-f6243cf5fda5 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:26.948665 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a12f2a80-ddf7-4956-aa7e-f6243cf5fda5 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:26.953282 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a12f2a80-ddf7-4956-aa7e-f6243cf5fda5 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:26.953282 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a12f2a80-ddf7-4956-aa7e-f6243cf5fda5 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:27.080084 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-a12f2a80-ddf7-4956-aa7e-f6243cf5fda5 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe37a6d57b4775b4e47a295c3f5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b2364f40d14160adf0220d92adaad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:13:27.087685 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-a12f2a80-ddf7-4956-aa7e-f6243cf5fda5 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982" status: 200 len: 1366 microversion: 2.1 time: 0.151788 May 31 21:13:27.088251 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 491/957] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:13:26 2022] GET /compute/v2.1/servers/5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:13:28.105099 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-f9948864-c2cb-47b3-a3aa-e7ac96ee021c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:13:28.105927 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-f9948864-c2cb-47b3-a3aa-e7ac96ee021c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:13:28.112777 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f9948864-c2cb-47b3-a3aa-e7ac96ee021c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:28.113297 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f9948864-c2cb-47b3-a3aa-e7ac96ee021c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:28.114125 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f9948864-c2cb-47b3-a3aa-e7ac96ee021c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:28.114574 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f9948864-c2cb-47b3-a3aa-e7ac96ee021c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:28.246805 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-f9948864-c2cb-47b3-a3aa-e7ac96ee021c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe37a6d57b4775b4e47a295c3f5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b2364f40d14160adf0220d92adaad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:13:28.256022 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-f9948864-c2cb-47b3-a3aa-e7ac96ee021c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982" status: 200 len: 1366 microversion: 2.1 time: 0.154854 May 31 21:13:28.258308 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 467/958] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:13:28 2022] GET /compute/v2.1/servers/5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:13:28.647114 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-4cf6d5ef-8b06-40ea-82ff-44d74bfca24a tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:13:28.647628 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-4cf6d5ef-8b06-40ea-82ff-44d74bfca24a tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: e26c2265-9a33-4c2a-9e41-6bf685f4c525] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:13:28.654409 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4cf6d5ef-8b06-40ea-82ff-44d74bfca24a tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:28.654856 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4cf6d5ef-8b06-40ea-82ff-44d74bfca24a tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:28.655623 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4cf6d5ef-8b06-40ea-82ff-44d74bfca24a tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:28.656053 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4cf6d5ef-8b06-40ea-82ff-44d74bfca24a tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:28.671746 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.wsgi [None req-4cf6d5ef-8b06-40ea-82ff-44d74bfca24a tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] HTTP exception thrown: Instance e26c2265-9a33-4c2a-9e41-6bf685f4c525 could not be found. May 31 21:13:28.673412 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-4cf6d5ef-8b06-40ea-82ff-44d74bfca24a tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Request method failure captured: May 31 21:13:28.673412 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: request: DELETE /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525 HTTP/1.1 May 31 21:13:28.673412 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Accept: application/json May 31 21:13:28.673412 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Accept-Encoding: identity May 31 21:13:28.673412 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Connection: close May 31 21:13:28.673412 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Content-Length: 0 May 31 21:13:28.673412 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Content-Type: application/json May 31 21:13:28.673412 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Host: 10.222.0.55 May 31 21:13:28.673412 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Openstack-System-Scope: None May 31 21:13:28.673412 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: User-Agent: python-urllib3/1.26.9 May 31 21:13:28.673412 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Auth-Token: gAAAAABiloKlkZoew85L1TdCmvO0RFP1xR5mXT6X2xEUB88pFhrUEE8uhof8Swf6MYZG3U_Q9b3Ivpfr-tfaWezatCne581AbmNbIqsdiz5siTPedALRZj6Qi0G6LR9gf9wTw3iAO_L_Nittc_1-f3oOlHbRyr-NnMcGkWfji8-9-Ep-WPTa_vI May 31 21:13:28.673412 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Domain-Id: None May 31 21:13:28.673412 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Domain-Name: None May 31 21:13:28.673412 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Identity-Status: Confirmed May 31 21:13:28.673412 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Is-Admin-Project: True May 31 21:13:28.673412 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Domain-Id: default May 31 21:13:28.673412 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Domain-Name: Default May 31 21:13:28.673412 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Id: 180ff6fd8c5b434abffa058ea99ef7c4 May 31 21:13:28.673412 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Name: tempest-AttachVolumeTestJSON-47090901 May 31 21:13:28.673412 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Role: member,reader May 31 21:13:28.673412 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Roles: member,reader May 31 21:13:28.675633 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/180ff6fd8c5b434abffa058ea99ef7c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/180ff6fd8c5b434abffa058ea99ef7c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_180ff6fd8c5b434abffa058ea99ef7c4", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/180ff6fd8c5b434abffa058ea99ef7c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] May 31 21:13:28.675633 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant: tempest-AttachVolumeTestJSON-47090901 May 31 21:13:28.675633 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant-Id: 180ff6fd8c5b434abffa058ea99ef7c4 May 31 21:13:28.675633 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant-Name: tempest-AttachVolumeTestJSON-47090901 May 31 21:13:28.675633 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User: tempest-AttachVolumeTestJSON-47090901-project May 31 21:13:28.675633 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Domain-Id: default May 31 21:13:28.675633 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Domain-Name: Default May 31 21:13:28.675633 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Id: 92d56ad8d4ab4c1099263a3d1c43490a May 31 21:13:28.675633 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Name: tempest-AttachVolumeTestJSON-47090901-project May 31 21:13:28.675633 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: method: > May 31 21:13:28.675633 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: exception: Instance e26c2265-9a33-4c2a-9e41-6bf685f4c525 could not be found. May 31 21:13:28.675633 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: action_args: {'id': 'e26c2265-9a33-4c2a-9e41-6bf685f4c525'} May 31 21:13:28.676461 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 21:13:28.676461 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:13:28.676461 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 21:13:28.676461 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 21:13:28.676461 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 21:13:28.676461 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 21:13:28.676461 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 21:13:28.676461 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 21:13:28.676461 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 21:13:28.676461 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 21:13:28.676461 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e26c2265-9a33-4c2a-9e41-6bf685f4c525 could not be found. May 31 21:13:28.676461 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:13:28.676461 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:13:28.676461 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:13:28.676461 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:13:28.676461 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:13:28.676461 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:13:28.676461 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 21:13:28.676461 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 21:13:28.676461 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 21:13:28.677919 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 21:13:28.677919 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 31 21:13:28.677919 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 31 21:13:28.677919 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 31 21:13:28.677919 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 31 21:13:28.677919 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 21:13:28.677919 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 21:13:28.677919 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 21:13:28.677919 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 21:13:28.677919 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e26c2265-9a33-4c2a-9e41-6bf685f4c525 could not be found. May 31 21:13:28.677919 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:13:28.677919 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:13:28.677919 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:13:28.677919 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:13:28.677919 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:13:28.677919 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:13:28.677919 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 21:13:28.677919 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 21:13:28.677919 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e26c2265-9a33-4c2a-9e41-6bf685f4c525 could not be found. May 31 21:13:28.677919 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:13:28.680396 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-4cf6d5ef-8b06-40ea-82ff-44d74bfca24a tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Returning 404 to user: Instance e26c2265-9a33-4c2a-9e41-6bf685f4c525 could not be found. {{(pid=118184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 21:13:28.680396 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-4cf6d5ef-8b06-40ea-82ff-44d74bfca24a tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "DELETE /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525" status: 404 len: 111 microversion: 2.1 time: 0.032812 May 31 21:13:28.680396 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 492/959] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 31 21:13:28 2022] DELETE /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 21:13:28.683912 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-2dd51c68-9adc-4057-96c6-9f6874eeb3b4 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:13:28.684553 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-2dd51c68-9adc-4057-96c6-9f6874eeb3b4 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: e26c2265-9a33-4c2a-9e41-6bf685f4c525] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:13:28.690590 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-2dd51c68-9adc-4057-96c6-9f6874eeb3b4 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:28.691050 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-2dd51c68-9adc-4057-96c6-9f6874eeb3b4 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:28.691822 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-2dd51c68-9adc-4057-96c6-9f6874eeb3b4 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:28.692259 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-2dd51c68-9adc-4057-96c6-9f6874eeb3b4 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:28.705583 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.wsgi [None req-2dd51c68-9adc-4057-96c6-9f6874eeb3b4 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] HTTP exception thrown: Instance e26c2265-9a33-4c2a-9e41-6bf685f4c525 could not be found. May 31 21:13:28.707602 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-2dd51c68-9adc-4057-96c6-9f6874eeb3b4 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Request method failure captured: May 31 21:13:28.707602 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: request: GET /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525 HTTP/1.1 May 31 21:13:28.707602 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Accept: application/json May 31 21:13:28.707602 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Accept-Encoding: identity May 31 21:13:28.707602 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Connection: close May 31 21:13:28.707602 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Content-Length: 0 May 31 21:13:28.707602 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Content-Type: application/json May 31 21:13:28.707602 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Host: 10.222.0.55 May 31 21:13:28.707602 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Openstack-System-Scope: None May 31 21:13:28.707602 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: User-Agent: python-urllib3/1.26.9 May 31 21:13:28.707602 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Auth-Token: gAAAAABiloKlkZoew85L1TdCmvO0RFP1xR5mXT6X2xEUB88pFhrUEE8uhof8Swf6MYZG3U_Q9b3Ivpfr-tfaWezatCne581AbmNbIqsdiz5siTPedALRZj6Qi0G6LR9gf9wTw3iAO_L_Nittc_1-f3oOlHbRyr-NnMcGkWfji8-9-Ep-WPTa_vI May 31 21:13:28.707602 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Domain-Id: None May 31 21:13:28.707602 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Domain-Name: None May 31 21:13:28.707602 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Identity-Status: Confirmed May 31 21:13:28.707602 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Is-Admin-Project: True May 31 21:13:28.707602 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Domain-Id: default May 31 21:13:28.707602 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Domain-Name: Default May 31 21:13:28.707602 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Id: 180ff6fd8c5b434abffa058ea99ef7c4 May 31 21:13:28.707602 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Name: tempest-AttachVolumeTestJSON-47090901 May 31 21:13:28.707602 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Role: member,reader May 31 21:13:28.707602 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Roles: member,reader May 31 21:13:28.709139 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/180ff6fd8c5b434abffa058ea99ef7c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/180ff6fd8c5b434abffa058ea99ef7c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_180ff6fd8c5b434abffa058ea99ef7c4", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/180ff6fd8c5b434abffa058ea99ef7c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] May 31 21:13:28.709139 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant: tempest-AttachVolumeTestJSON-47090901 May 31 21:13:28.709139 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant-Id: 180ff6fd8c5b434abffa058ea99ef7c4 May 31 21:13:28.709139 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant-Name: tempest-AttachVolumeTestJSON-47090901 May 31 21:13:28.709139 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User: tempest-AttachVolumeTestJSON-47090901-project May 31 21:13:28.709139 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Domain-Id: default May 31 21:13:28.709139 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Domain-Name: Default May 31 21:13:28.709139 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Id: 92d56ad8d4ab4c1099263a3d1c43490a May 31 21:13:28.709139 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Name: tempest-AttachVolumeTestJSON-47090901-project May 31 21:13:28.709139 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: method: > May 31 21:13:28.709139 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: exception: Instance e26c2265-9a33-4c2a-9e41-6bf685f4c525 could not be found. May 31 21:13:28.709139 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: action_args: {'id': 'e26c2265-9a33-4c2a-9e41-6bf685f4c525'} May 31 21:13:28.710075 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 21:13:28.710075 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:13:28.710075 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 21:13:28.710075 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 21:13:28.710075 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 21:13:28.710075 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 21:13:28.710075 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 21:13:28.710075 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 21:13:28.710075 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 21:13:28.710075 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 21:13:28.710075 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e26c2265-9a33-4c2a-9e41-6bf685f4c525 could not be found. May 31 21:13:28.710075 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:13:28.710075 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:13:28.710075 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:13:28.710075 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:13:28.710075 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:13:28.710075 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:13:28.710075 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 21:13:28.710075 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 21:13:28.710075 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 21:13:28.711299 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 21:13:28.711299 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 21:13:28.711299 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 21:13:28.711299 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 21:13:28.711299 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 21:13:28.711299 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 21:13:28.711299 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 21:13:28.711299 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e26c2265-9a33-4c2a-9e41-6bf685f4c525 could not be found. May 31 21:13:28.711299 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:13:28.711299 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:13:28.711299 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:13:28.711299 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:13:28.711299 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:13:28.711299 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:13:28.711299 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 21:13:28.711299 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 21:13:28.711299 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e26c2265-9a33-4c2a-9e41-6bf685f4c525 could not be found. May 31 21:13:28.711299 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:13:28.712493 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-2dd51c68-9adc-4057-96c6-9f6874eeb3b4 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Returning 404 to user: Instance e26c2265-9a33-4c2a-9e41-6bf685f4c525 could not be found. {{(pid=118185) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 21:13:28.712493 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-2dd51c68-9adc-4057-96c6-9f6874eeb3b4 tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525" status: 404 len: 111 microversion: 2.1 time: 0.028837 May 31 21:13:28.712493 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 468/960] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:13:28 2022] GET /compute/v2.1/servers/e26c2265-9a33-4c2a-9e41-6bf685f4c525 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 21:13:29.273315 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-2ab896fd-1b5c-49d1-bdfb-381f3b9b2831 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:13:29.274176 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-2ab896fd-1b5c-49d1-bdfb-381f3b9b2831 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:13:29.280823 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2ab896fd-1b5c-49d1-bdfb-381f3b9b2831 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:29.281267 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2ab896fd-1b5c-49d1-bdfb-381f3b9b2831 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:29.282080 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2ab896fd-1b5c-49d1-bdfb-381f3b9b2831 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:29.282514 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2ab896fd-1b5c-49d1-bdfb-381f3b9b2831 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:29.417018 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-2ab896fd-1b5c-49d1-bdfb-381f3b9b2831 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe37a6d57b4775b4e47a295c3f5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b2364f40d14160adf0220d92adaad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:13:29.424472 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-2ab896fd-1b5c-49d1-bdfb-381f3b9b2831 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982" status: 200 len: 1366 microversion: 2.1 time: 0.155202 May 31 21:13:29.425031 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 493/961] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:13:29 2022] GET /compute/v2.1/servers/5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:13:29.987382 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-485196ef-94af-4cc1-8297-62611511363d tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:13:29.987913 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-485196ef-94af-4cc1-8297-62611511363d tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:13:29.994382 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-485196ef-94af-4cc1-8297-62611511363d tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:29.994831 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-485196ef-94af-4cc1-8297-62611511363d tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:29.995594 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-485196ef-94af-4cc1-8297-62611511363d tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:29.996023 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-485196ef-94af-4cc1-8297-62611511363d tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:30.009270 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.wsgi [None req-485196ef-94af-4cc1-8297-62611511363d tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] HTTP exception thrown: Instance faf12fce-2352-40df-a297-0d7b28379014 could not be found. May 31 21:13:30.010886 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-485196ef-94af-4cc1-8297-62611511363d tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Request method failure captured: May 31 21:13:30.010886 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: request: DELETE /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 HTTP/1.1 May 31 21:13:30.010886 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Accept: application/json May 31 21:13:30.010886 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Accept-Encoding: identity May 31 21:13:30.010886 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Connection: close May 31 21:13:30.010886 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Content-Length: 0 May 31 21:13:30.010886 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Content-Type: application/json May 31 21:13:30.010886 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Host: 10.222.0.55 May 31 21:13:30.010886 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Openstack-System-Scope: None May 31 21:13:30.010886 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: User-Agent: python-urllib3/1.26.9 May 31 21:13:30.010886 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Auth-Token: gAAAAABiloKlkZoew85L1TdCmvO0RFP1xR5mXT6X2xEUB88pFhrUEE8uhof8Swf6MYZG3U_Q9b3Ivpfr-tfaWezatCne581AbmNbIqsdiz5siTPedALRZj6Qi0G6LR9gf9wTw3iAO_L_Nittc_1-f3oOlHbRyr-NnMcGkWfji8-9-Ep-WPTa_vI May 31 21:13:30.010886 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Domain-Id: None May 31 21:13:30.010886 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Domain-Name: None May 31 21:13:30.010886 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Identity-Status: Confirmed May 31 21:13:30.010886 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Is-Admin-Project: True May 31 21:13:30.010886 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Domain-Id: default May 31 21:13:30.010886 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Domain-Name: Default May 31 21:13:30.010886 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Id: 180ff6fd8c5b434abffa058ea99ef7c4 May 31 21:13:30.010886 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Name: tempest-AttachVolumeTestJSON-47090901 May 31 21:13:30.010886 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Role: member,reader May 31 21:13:30.010886 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Roles: member,reader May 31 21:13:30.012430 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/180ff6fd8c5b434abffa058ea99ef7c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/180ff6fd8c5b434abffa058ea99ef7c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_180ff6fd8c5b434abffa058ea99ef7c4", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/180ff6fd8c5b434abffa058ea99ef7c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] May 31 21:13:30.012430 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant: tempest-AttachVolumeTestJSON-47090901 May 31 21:13:30.012430 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant-Id: 180ff6fd8c5b434abffa058ea99ef7c4 May 31 21:13:30.012430 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant-Name: tempest-AttachVolumeTestJSON-47090901 May 31 21:13:30.012430 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User: tempest-AttachVolumeTestJSON-47090901-project May 31 21:13:30.012430 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Domain-Id: default May 31 21:13:30.012430 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Domain-Name: Default May 31 21:13:30.012430 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Id: 92d56ad8d4ab4c1099263a3d1c43490a May 31 21:13:30.012430 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Name: tempest-AttachVolumeTestJSON-47090901-project May 31 21:13:30.012430 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: method: > May 31 21:13:30.012430 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: exception: Instance faf12fce-2352-40df-a297-0d7b28379014 could not be found. May 31 21:13:30.012430 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: action_args: {'id': 'faf12fce-2352-40df-a297-0d7b28379014'} May 31 21:13:30.013248 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 21:13:30.013248 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:13:30.013248 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 21:13:30.013248 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 21:13:30.013248 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 21:13:30.013248 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 21:13:30.013248 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 21:13:30.013248 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 21:13:30.013248 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 21:13:30.013248 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 21:13:30.013248 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance faf12fce-2352-40df-a297-0d7b28379014 could not be found. May 31 21:13:30.013248 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:13:30.013248 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:13:30.013248 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:13:30.013248 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:13:30.013248 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:13:30.013248 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:13:30.013248 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 21:13:30.013248 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 21:13:30.013248 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 21:13:30.014464 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 21:13:30.014464 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 31 21:13:30.014464 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 31 21:13:30.014464 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 31 21:13:30.014464 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 31 21:13:30.014464 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 21:13:30.014464 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 21:13:30.014464 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 21:13:30.014464 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 21:13:30.014464 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance faf12fce-2352-40df-a297-0d7b28379014 could not be found. May 31 21:13:30.014464 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:13:30.014464 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:13:30.014464 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:13:30.014464 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:13:30.014464 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:13:30.014464 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:13:30.014464 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 21:13:30.014464 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 21:13:30.014464 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance faf12fce-2352-40df-a297-0d7b28379014 could not be found. May 31 21:13:30.014464 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:13:30.015757 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-485196ef-94af-4cc1-8297-62611511363d tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Returning 404 to user: Instance faf12fce-2352-40df-a297-0d7b28379014 could not be found. {{(pid=118185) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 21:13:30.015757 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-485196ef-94af-4cc1-8297-62611511363d tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "DELETE /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 404 len: 111 microversion: 2.1 time: 0.028837 May 31 21:13:30.015757 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 469/962] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 31 21:13:29 2022] DELETE /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 21:13:30.021449 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-2b812f35-33b5-4e2d-b285-26c873d0c84d tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:13:30.022098 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-2b812f35-33b5-4e2d-b285-26c873d0c84d tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] [instance: faf12fce-2352-40df-a297-0d7b28379014] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:13:30.028643 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2b812f35-33b5-4e2d-b285-26c873d0c84d tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:30.029090 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2b812f35-33b5-4e2d-b285-26c873d0c84d tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:30.029852 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2b812f35-33b5-4e2d-b285-26c873d0c84d tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:30.030389 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2b812f35-33b5-4e2d-b285-26c873d0c84d tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:30.044162 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.wsgi [None req-2b812f35-33b5-4e2d-b285-26c873d0c84d tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] HTTP exception thrown: Instance faf12fce-2352-40df-a297-0d7b28379014 could not be found. May 31 21:13:30.045684 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-2b812f35-33b5-4e2d-b285-26c873d0c84d tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Request method failure captured: May 31 21:13:30.045684 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: request: GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 HTTP/1.1 May 31 21:13:30.045684 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Accept: application/json May 31 21:13:30.045684 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Accept-Encoding: identity May 31 21:13:30.045684 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Connection: close May 31 21:13:30.045684 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Content-Length: 0 May 31 21:13:30.045684 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Content-Type: application/json May 31 21:13:30.045684 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Host: 10.222.0.55 May 31 21:13:30.045684 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Openstack-System-Scope: None May 31 21:13:30.045684 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: User-Agent: python-urllib3/1.26.9 May 31 21:13:30.045684 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Auth-Token: gAAAAABiloKlkZoew85L1TdCmvO0RFP1xR5mXT6X2xEUB88pFhrUEE8uhof8Swf6MYZG3U_Q9b3Ivpfr-tfaWezatCne581AbmNbIqsdiz5siTPedALRZj6Qi0G6LR9gf9wTw3iAO_L_Nittc_1-f3oOlHbRyr-NnMcGkWfji8-9-Ep-WPTa_vI May 31 21:13:30.045684 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Domain-Id: None May 31 21:13:30.045684 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Domain-Name: None May 31 21:13:30.045684 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Identity-Status: Confirmed May 31 21:13:30.045684 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Is-Admin-Project: True May 31 21:13:30.045684 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Domain-Id: default May 31 21:13:30.045684 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Domain-Name: Default May 31 21:13:30.045684 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Id: 180ff6fd8c5b434abffa058ea99ef7c4 May 31 21:13:30.045684 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Name: tempest-AttachVolumeTestJSON-47090901 May 31 21:13:30.045684 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Role: member,reader May 31 21:13:30.045684 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Roles: member,reader May 31 21:13:30.047205 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/180ff6fd8c5b434abffa058ea99ef7c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/180ff6fd8c5b434abffa058ea99ef7c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_180ff6fd8c5b434abffa058ea99ef7c4", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/180ff6fd8c5b434abffa058ea99ef7c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] May 31 21:13:30.047205 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant: tempest-AttachVolumeTestJSON-47090901 May 31 21:13:30.047205 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant-Id: 180ff6fd8c5b434abffa058ea99ef7c4 May 31 21:13:30.047205 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant-Name: tempest-AttachVolumeTestJSON-47090901 May 31 21:13:30.047205 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User: tempest-AttachVolumeTestJSON-47090901-project May 31 21:13:30.047205 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Domain-Id: default May 31 21:13:30.047205 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Domain-Name: Default May 31 21:13:30.047205 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Id: 92d56ad8d4ab4c1099263a3d1c43490a May 31 21:13:30.047205 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Name: tempest-AttachVolumeTestJSON-47090901-project May 31 21:13:30.047205 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: method: > May 31 21:13:30.047205 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: exception: Instance faf12fce-2352-40df-a297-0d7b28379014 could not be found. May 31 21:13:30.047205 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: action_args: {'id': 'faf12fce-2352-40df-a297-0d7b28379014'} May 31 21:13:30.048047 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 21:13:30.048047 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:13:30.048047 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 21:13:30.048047 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 21:13:30.048047 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 21:13:30.048047 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 21:13:30.048047 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 21:13:30.048047 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 21:13:30.048047 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 21:13:30.048047 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 21:13:30.048047 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance faf12fce-2352-40df-a297-0d7b28379014 could not be found. May 31 21:13:30.048047 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:13:30.048047 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:13:30.048047 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:13:30.048047 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:13:30.048047 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:13:30.048047 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:13:30.048047 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 21:13:30.048047 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 21:13:30.048047 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 21:13:30.049467 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 21:13:30.049467 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 21:13:30.049467 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 21:13:30.049467 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 21:13:30.049467 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 21:13:30.049467 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 21:13:30.049467 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 21:13:30.049467 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance faf12fce-2352-40df-a297-0d7b28379014 could not be found. May 31 21:13:30.049467 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:13:30.049467 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:13:30.049467 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:13:30.049467 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:13:30.049467 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:13:30.049467 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:13:30.049467 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 21:13:30.049467 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 21:13:30.049467 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance faf12fce-2352-40df-a297-0d7b28379014 could not be found. May 31 21:13:30.049467 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:13:30.050844 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-2b812f35-33b5-4e2d-b285-26c873d0c84d tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] Returning 404 to user: Instance faf12fce-2352-40df-a297-0d7b28379014 could not be found. {{(pid=118184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 21:13:30.050844 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-2b812f35-33b5-4e2d-b285-26c873d0c84d tempest-AttachVolumeTestJSON-47090901 tempest-AttachVolumeTestJSON-47090901-project] 10.222.0.55 "GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014" status: 404 len: 111 microversion: 2.1 time: 0.030091 May 31 21:13:30.050844 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 494/963] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:13:30 2022] GET /compute/v2.1/servers/faf12fce-2352-40df-a297-0d7b28379014 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 21:13:30.442144 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-22c79c49-d3dc-46e6-83de-e44cf261f059 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:13:30.442771 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-22c79c49-d3dc-46e6-83de-e44cf261f059 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:13:30.449314 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-22c79c49-d3dc-46e6-83de-e44cf261f059 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:30.449770 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-22c79c49-d3dc-46e6-83de-e44cf261f059 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:30.450602 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-22c79c49-d3dc-46e6-83de-e44cf261f059 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:30.451145 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-22c79c49-d3dc-46e6-83de-e44cf261f059 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:30.651550 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-22c79c49-d3dc-46e6-83de-e44cf261f059 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe37a6d57b4775b4e47a295c3f5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b2364f40d14160adf0220d92adaad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:13:30.659587 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-22c79c49-d3dc-46e6-83de-e44cf261f059 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982" status: 200 len: 1366 microversion: 2.1 time: 0.221516 May 31 21:13:30.660161 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 470/964] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:13:30 2022] GET /compute/v2.1/servers/5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982 => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:13:31.449783 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [req-c21c898b-418c-4570-a41b-c666f763b681 req-663e9338-67f9-40e9-a1dc-f23389ec36d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982", "name": "network-vif-plugged", "status": "completed", "tag": "d2db5c87-efce-4692-aa2a-48540d4ccc40"}]} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:13:31.454445 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell0:SELECT=6 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:13:31.461179 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-c21c898b-418c-4570-a41b-c666f763b681 req-663e9338-67f9-40e9-a1dc-f23389ec36d9 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:31.461773 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-c21c898b-418c-4570-a41b-c666f763b681 req-663e9338-67f9-40e9-a1dc-f23389ec36d9 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:31.475022 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.compute.server_external_events [req-c21c898b-418c-4570-a41b-c666f763b681 req-663e9338-67f9-40e9-a1dc-f23389ec36d9 service nova] Creating event network-vif-plugged:d2db5c87-efce-4692-aa2a-48540d4ccc40 for instance 5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982 on hv-cinder-83979 May 31 21:13:31.480311 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [req-c21c898b-418c-4570-a41b-c666f763b681 req-663e9338-67f9-40e9-a1dc-f23389ec36d9 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038688 May 31 21:13:31.481345 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 495/965] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:13:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:13:31.677626 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-d9ff2fd5-f107-478b-8443-66d1aca6874a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:13:31.678225 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-d9ff2fd5-f107-478b-8443-66d1aca6874a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:13:31.680208 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell0:SELECT=2 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:13:31.680880 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell0:SELECT=6 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:13:31.685726 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-d9ff2fd5-f107-478b-8443-66d1aca6874a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:31.687381 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-d9ff2fd5-f107-478b-8443-66d1aca6874a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:31.687381 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-d9ff2fd5-f107-478b-8443-66d1aca6874a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:31.687570 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-d9ff2fd5-f107-478b-8443-66d1aca6874a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:31.949293 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-d9ff2fd5-f107-478b-8443-66d1aca6874a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe37a6d57b4775b4e47a295c3f5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b2364f40d14160adf0220d92adaad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:13:31.958475 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-d9ff2fd5-f107-478b-8443-66d1aca6874a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982" status: 200 len: 1366 microversion: 2.1 time: 0.285789 May 31 21:13:31.959434 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 471/966] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:13:31 2022] GET /compute/v2.1/servers/5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982 => generated 1366 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:13:32.976875 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-b2e81125-00a7-466a-bffa-844719e874cc tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:13:32.977694 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-b2e81125-00a7-466a-bffa-844719e874cc tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:13:32.984098 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b2e81125-00a7-466a-bffa-844719e874cc tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:32.984547 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b2e81125-00a7-466a-bffa-844719e874cc tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:32.985309 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b2e81125-00a7-466a-bffa-844719e874cc tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:32.985742 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b2e81125-00a7-466a-bffa-844719e874cc tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:33.120817 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-b2e81125-00a7-466a-bffa-844719e874cc tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe37a6d57b4775b4e47a295c3f5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b2364f40d14160adf0220d92adaad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:13:33.128356 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-b2e81125-00a7-466a-bffa-844719e874cc tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982" status: 200 len: 1366 microversion: 2.1 time: 0.156697 May 31 21:13:33.128913 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 496/967] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:13:32 2022] GET /compute/v2.1/servers/5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:13:34.145331 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-515d70fe-dcc1-43dc-bae3-269bf04ab39d tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:13:34.146098 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-515d70fe-dcc1-43dc-bae3-269bf04ab39d tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:13:34.152424 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-515d70fe-dcc1-43dc-bae3-269bf04ab39d tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:34.157043 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-515d70fe-dcc1-43dc-bae3-269bf04ab39d tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:34.157043 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-515d70fe-dcc1-43dc-bae3-269bf04ab39d tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:34.157043 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-515d70fe-dcc1-43dc-bae3-269bf04ab39d tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:34.287286 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-515d70fe-dcc1-43dc-bae3-269bf04ab39d tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe37a6d57b4775b4e47a295c3f5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b2364f40d14160adf0220d92adaad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:13:34.294993 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-515d70fe-dcc1-43dc-bae3-269bf04ab39d tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982" status: 200 len: 1556 microversion: 2.1 time: 0.154226 May 31 21:13:34.295588 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 472/968] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:13:34 2022] GET /compute/v2.1/servers/5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982 => generated 1556 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:13:34.317143 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-7a134351-d87a-448c-9cc0-441ed9d8d0a5 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:13:34.317801 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-7a134351-d87a-448c-9cc0-441ed9d8d0a5 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:13:34.324318 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7a134351-d87a-448c-9cc0-441ed9d8d0a5 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:34.324773 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7a134351-d87a-448c-9cc0-441ed9d8d0a5 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:34.325539 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7a134351-d87a-448c-9cc0-441ed9d8d0a5 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:34.326008 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7a134351-d87a-448c-9cc0-441ed9d8d0a5 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:34.404815 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-7a134351-d87a-448c-9cc0-441ed9d8d0a5 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092130 May 31 21:13:34.405415 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 497/969] 10.222.0.55 () {58 vars in 1274 bytes} [Tue May 31 21:13:34 2022] GET /compute/v2.1/servers/5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:13:35.450299 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [req-133e25ad-81f1-490c-a93e-ea66f2fd28b4 req-365c2a7e-7b98-4765-bf28-e1c68ceffa29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982", "tag": "d2db5c87-efce-4692-aa2a-48540d4ccc40"}]} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:13:35.460125 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-133e25ad-81f1-490c-a93e-ea66f2fd28b4 req-365c2a7e-7b98-4765-bf28-e1c68ceffa29 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:35.460803 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-133e25ad-81f1-490c-a93e-ea66f2fd28b4 req-365c2a7e-7b98-4765-bf28-e1c68ceffa29 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:35.475354 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.compute.server_external_events [req-133e25ad-81f1-490c-a93e-ea66f2fd28b4 req-365c2a7e-7b98-4765-bf28-e1c68ceffa29 service nova] Creating event network-changed:d2db5c87-efce-4692-aa2a-48540d4ccc40 for instance 5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982 on hv-cinder-83979 May 31 21:13:35.480856 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [req-133e25ad-81f1-490c-a93e-ea66f2fd28b4 req-365c2a7e-7b98-4765-bf28-e1c68ceffa29 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034114 May 31 21:13:35.481952 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 473/970] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:13:43.692927 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 21:13:43.693538 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Tue May 31 21:13:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 21:13:53.761449 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:13:53.762265 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell1:SELECT=63 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:13:53.766319 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-82efafad-79bf-40e8-aba0-deb08f769c0c tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:13:53.767617 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-82efafad-79bf-40e8-aba0-deb08f769c0c tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:13:53.774569 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-82efafad-79bf-40e8-aba0-deb08f769c0c tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:53.775021 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-82efafad-79bf-40e8-aba0-deb08f769c0c tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:53.775789 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-82efafad-79bf-40e8-aba0-deb08f769c0c tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:53.776223 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-82efafad-79bf-40e8-aba0-deb08f769c0c tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:53.809753 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-82efafad-79bf-40e8-aba0-deb08f769c0c tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049670 May 31 21:13:53.813634 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 498/971] 10.222.0.55 () {60 vars in 1342 bytes} [Tue May 31 21:13:53 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:13:53.867961 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-bd414ff9-ef40-4f48-9905-c962e749a230 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:13:53.868556 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-bd414ff9-ef40-4f48-9905-c962e749a230 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:13:53.870923 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:13:53.871582 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:13:53.876534 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-bd414ff9-ef40-4f48-9905-c962e749a230 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:53.876985 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-bd414ff9-ef40-4f48-9905-c962e749a230 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:53.877748 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-bd414ff9-ef40-4f48-9905-c962e749a230 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:53.878208 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-bd414ff9-ef40-4f48-9905-c962e749a230 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:53.902785 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-bd414ff9-ef40-4f48-9905-c962e749a230 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Going to try to terminate instance {{(pid=118185) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 21:13:54.157858 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-bd414ff9-ef40-4f48-9905-c962e749a230 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "DELETE /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 204 len: 0 microversion: 2.20 time: 0.293792 May 31 21:13:54.159210 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 474/972] 10.222.0.55 () {60 vars in 1279 bytes} [Tue May 31 21:13:53 2022] DELETE /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 31 21:13:54.167133 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-309a3400-2297-4049-bce8-00aa62d70b3f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:13:54.167747 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-309a3400-2297-4049-bce8-00aa62d70b3f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:13:54.174376 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-309a3400-2297-4049-bce8-00aa62d70b3f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:54.174834 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-309a3400-2297-4049-bce8-00aa62d70b3f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:54.175622 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-309a3400-2297-4049-bce8-00aa62d70b3f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:54.176062 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-309a3400-2297-4049-bce8-00aa62d70b3f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:54.304314 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-309a3400-2297-4049-bce8-00aa62d70b3f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:13:54.312390 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-309a3400-2297-4049-bce8-00aa62d70b3f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:13:54.313945 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-309a3400-2297-4049-bce8-00aa62d70b3f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:13:54.315113 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-309a3400-2297-4049-bce8-00aa62d70b3f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1719 microversion: 2.20 time: 0.152274 May 31 21:13:54.315672 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 499/973] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:13:54 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1719 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:13:55.335676 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-a81c6fb0-5358-426e-85e3-74001c044b3c tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:13:55.336365 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-a81c6fb0-5358-426e-85e3-74001c044b3c tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:13:55.343778 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a81c6fb0-5358-426e-85e3-74001c044b3c tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:55.344261 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a81c6fb0-5358-426e-85e3-74001c044b3c tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:55.345051 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a81c6fb0-5358-426e-85e3-74001c044b3c tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:55.345484 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a81c6fb0-5358-426e-85e3-74001c044b3c tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:55.732984 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-a81c6fb0-5358-426e-85e3-74001c044b3c tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:13:55.740967 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-a81c6fb0-5358-426e-85e3-74001c044b3c tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:13:55.745638 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-a81c6fb0-5358-426e-85e3-74001c044b3c tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:13:55.746823 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-a81c6fb0-5358-426e-85e3-74001c044b3c tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1719 microversion: 2.20 time: 0.416698 May 31 21:13:55.747378 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 475/974] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:13:55 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1719 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:13:56.765974 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-bd925212-78dc-4757-bb63-e89fc43c5705 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:13:56.766583 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-bd925212-78dc-4757-bb63-e89fc43c5705 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:13:56.773605 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-bd925212-78dc-4757-bb63-e89fc43c5705 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:56.774096 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-bd925212-78dc-4757-bb63-e89fc43c5705 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:56.774853 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-bd925212-78dc-4757-bb63-e89fc43c5705 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:56.775290 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-bd925212-78dc-4757-bb63-e89fc43c5705 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:56.904190 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-bd925212-78dc-4757-bb63-e89fc43c5705 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:13:56.912790 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-bd925212-78dc-4757-bb63-e89fc43c5705 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:13:56.915739 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-bd925212-78dc-4757-bb63-e89fc43c5705 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:13:56.915739 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-bd925212-78dc-4757-bb63-e89fc43c5705 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1719 microversion: 2.20 time: 0.153470 May 31 21:13:56.916037 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 500/975] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:13:56 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1719 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:13:57.934228 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-9cac7e9c-cfea-4cca-a1ff-3ae2bdcb804a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:13:57.935118 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-9cac7e9c-cfea-4cca-a1ff-3ae2bdcb804a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:13:57.941746 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9cac7e9c-cfea-4cca-a1ff-3ae2bdcb804a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:57.942220 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9cac7e9c-cfea-4cca-a1ff-3ae2bdcb804a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:57.942978 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9cac7e9c-cfea-4cca-a1ff-3ae2bdcb804a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:57.943404 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9cac7e9c-cfea-4cca-a1ff-3ae2bdcb804a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:58.078403 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-9cac7e9c-cfea-4cca-a1ff-3ae2bdcb804a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:13:58.087096 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-9cac7e9c-cfea-4cca-a1ff-3ae2bdcb804a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:13:58.088588 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-9cac7e9c-cfea-4cca-a1ff-3ae2bdcb804a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:13:58.089729 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-9cac7e9c-cfea-4cca-a1ff-3ae2bdcb804a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1719 microversion: 2.20 time: 0.159900 May 31 21:13:58.090310 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 476/976] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:13:57 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1719 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:13:59.107582 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-a02ac703-7f19-47d9-95eb-84ba2bd7664f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:13:59.108184 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-a02ac703-7f19-47d9-95eb-84ba2bd7664f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:13:59.114914 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a02ac703-7f19-47d9-95eb-84ba2bd7664f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:59.115364 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a02ac703-7f19-47d9-95eb-84ba2bd7664f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:59.116129 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a02ac703-7f19-47d9-95eb-84ba2bd7664f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:13:59.116561 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a02ac703-7f19-47d9-95eb-84ba2bd7664f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:13:59.244066 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-a02ac703-7f19-47d9-95eb-84ba2bd7664f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:13:59.252024 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-a02ac703-7f19-47d9-95eb-84ba2bd7664f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:13:59.254231 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-a02ac703-7f19-47d9-95eb-84ba2bd7664f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:13:59.255388 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-a02ac703-7f19-47d9-95eb-84ba2bd7664f tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1719 microversion: 2.20 time: 0.151665 May 31 21:13:59.255940 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 501/977] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:13:59 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1719 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:14:00.276115 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-b1481894-c297-4c90-afe5-b4a60a4f632b tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:14:00.277082 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-b1481894-c297-4c90-afe5-b4a60a4f632b tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:14:00.284372 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b1481894-c297-4c90-afe5-b4a60a4f632b tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:14:00.284896 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b1481894-c297-4c90-afe5-b4a60a4f632b tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:14:00.285935 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b1481894-c297-4c90-afe5-b4a60a4f632b tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:14:00.286375 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b1481894-c297-4c90-afe5-b4a60a4f632b tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:14:00.355297 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-b1481894-c297-4c90-afe5-b4a60a4f632b tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:14:00.363747 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-b1481894-c297-4c90-afe5-b4a60a4f632b tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:14:00.365249 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-b1481894-c297-4c90-afe5-b4a60a4f632b tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:14:00.366454 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-b1481894-c297-4c90-afe5-b4a60a4f632b tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1652 microversion: 2.20 time: 0.095600 May 31 21:14:00.367011 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 477/978] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:14:00 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1652 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:14:00.466684 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [req-89097390-9a6d-4b8c-b31c-862ccbe0593f req-4301e03e-5f37-4e03-a807-606a1fc21996 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d316a51-73db-479f-8449-ab51b42548e4", "name": "network-vif-deleted", "tag": "ad3164a5-db8a-4332-a6c0-bcd7015cabda"}]} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:14:00.475159 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-89097390-9a6d-4b8c-b31c-862ccbe0593f req-4301e03e-5f37-4e03-a807-606a1fc21996 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:14:00.475815 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-89097390-9a6d-4b8c-b31c-862ccbe0593f req-4301e03e-5f37-4e03-a807-606a1fc21996 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:14:00.487083 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.compute.server_external_events [req-89097390-9a6d-4b8c-b31c-862ccbe0593f req-4301e03e-5f37-4e03-a807-606a1fc21996 service nova] Creating event network-vif-deleted:ad3164a5-db8a-4332-a6c0-bcd7015cabda for instance 1d316a51-73db-479f-8449-ab51b42548e4 on hv-cinder-83979 May 31 21:14:00.492790 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [req-89097390-9a6d-4b8c-b31c-862ccbe0593f req-4301e03e-5f37-4e03-a807-606a1fc21996 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029665 May 31 21:14:00.495636 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 502/979] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:14:01.385494 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-1b8d460d-75ad-40aa-aa25-5e7cdd939af1 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:14:01.386299 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-1b8d460d-75ad-40aa-aa25-5e7cdd939af1 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:14:01.393182 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-1b8d460d-75ad-40aa-aa25-5e7cdd939af1 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:14:01.393713 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-1b8d460d-75ad-40aa-aa25-5e7cdd939af1 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:14:01.395227 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-1b8d460d-75ad-40aa-aa25-5e7cdd939af1 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:14:01.395227 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-1b8d460d-75ad-40aa-aa25-5e7cdd939af1 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:14:01.432443 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-1b8d460d-75ad-40aa-aa25-5e7cdd939af1 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:14:01.432908 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-1b8d460d-75ad-40aa-aa25-5e7cdd939af1 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:14:01.433596 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.objects.instance [None req-1b8d460d-75ad-40aa-aa25-5e7cdd939af1 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lazy-loading 'fault' on Instance uuid 1d316a51-73db-479f-8449-ab51b42548e4 {{(pid=118185) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 21:14:01.484142 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-1b8d460d-75ad-40aa-aa25-5e7cdd939af1 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:14:01.491847 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-1b8d460d-75ad-40aa-aa25-5e7cdd939af1 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:14:01.493437 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-1b8d460d-75ad-40aa-aa25-5e7cdd939af1 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d69edafe80649d4aff602b692e294c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af420d43367c42e4a4b0948706dd0546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:14:01.494841 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-1b8d460d-75ad-40aa-aa25-5e7cdd939af1 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 200 len: 1368 microversion: 2.20 time: 0.113305 May 31 21:14:01.495202 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 478/980] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:14:01 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 1368 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 21:14:02.513860 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-b7c75f1a-8177-4bc4-b61b-21b52c8a20ce tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:14:02.514530 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-b7c75f1a-8177-4bc4-b61b-21b52c8a20ce tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:14:02.521526 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b7c75f1a-8177-4bc4-b61b-21b52c8a20ce tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:14:02.522018 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b7c75f1a-8177-4bc4-b61b-21b52c8a20ce tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:14:02.522799 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b7c75f1a-8177-4bc4-b61b-21b52c8a20ce tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:14:02.523244 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b7c75f1a-8177-4bc4-b61b-21b52c8a20ce tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:14:02.541744 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.wsgi [None req-b7c75f1a-8177-4bc4-b61b-21b52c8a20ce tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] HTTP exception thrown: Instance 1d316a51-73db-479f-8449-ab51b42548e4 could not be found. May 31 21:14:02.541744 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-b7c75f1a-8177-4bc4-b61b-21b52c8a20ce tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Request method failure captured: May 31 21:14:02.541744 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: request: GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 HTTP/1.1 May 31 21:14:02.541744 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Accept: application/json May 31 21:14:02.541744 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Accept-Encoding: identity May 31 21:14:02.541744 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Connection: close May 31 21:14:02.541744 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Content-Length: 0 May 31 21:14:02.541744 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Content-Type: application/json May 31 21:14:02.541744 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Host: 10.222.0.55 May 31 21:14:02.541744 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Openstack-System-Scope: None May 31 21:14:02.541744 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: User-Agent: python-urllib3/1.26.9 May 31 21:14:02.541744 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Auth-Token: gAAAAABiloKnJ_2lcEUHBtqGonwFAPKRN4u6Jj98V992qyB0RgFvh645yLhj_58i3K3xDrLOaAAGNimOespdwH_ZYG39Jef0nTIRBuLPvIp-1Cg1Jsm5xXNNM1pUdYoFw8vP7YFqBeGsVa011fgNOghwwGaORJ5Bk8xEcqBovJ_HNYR4r3OFkyg May 31 21:14:02.541744 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Domain-Id: None May 31 21:14:02.541744 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Domain-Name: None May 31 21:14:02.541744 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Identity-Status: Confirmed May 31 21:14:02.541744 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Is-Admin-Project: True May 31 21:14:02.541744 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Openstack-Nova-Api-Version: 2.20 May 31 21:14:02.541744 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Domain-Id: default May 31 21:14:02.541744 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Domain-Name: Default May 31 21:14:02.541744 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Id: af420d43367c42e4a4b0948706dd0546 May 31 21:14:02.541744 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-861773528 May 31 21:14:02.541744 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Role: member,reader May 31 21:14:02.541744 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Roles: member,reader May 31 21:14:02.543548 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/af420d43367c42e4a4b0948706dd0546"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/af420d43367c42e4a4b0948706dd0546"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_af420d43367c42e4a4b0948706dd0546", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/af420d43367c42e4a4b0948706dd0546"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] May 31 21:14:02.543548 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant: tempest-AttachVolumeShelveTestJSON-861773528 May 31 21:14:02.543548 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant-Id: af420d43367c42e4a4b0948706dd0546 May 31 21:14:02.543548 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-861773528 May 31 21:14:02.543548 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User: tempest-AttachVolumeShelveTestJSON-861773528-project May 31 21:14:02.543548 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Domain-Id: default May 31 21:14:02.543548 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Domain-Name: Default May 31 21:14:02.543548 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Id: 2d69edafe80649d4aff602b692e294c8 May 31 21:14:02.543548 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Name: tempest-AttachVolumeShelveTestJSON-861773528-project May 31 21:14:02.543548 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: method: > May 31 21:14:02.543548 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: exception: Instance 1d316a51-73db-479f-8449-ab51b42548e4 could not be found. May 31 21:14:02.543548 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: action_args: {'id': '1d316a51-73db-479f-8449-ab51b42548e4'} May 31 21:14:02.544429 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 21:14:02.544429 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:14:02.544429 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 21:14:02.544429 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 21:14:02.544429 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 21:14:02.544429 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 21:14:02.544429 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 21:14:02.544429 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 21:14:02.544429 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 21:14:02.544429 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 21:14:02.544429 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d316a51-73db-479f-8449-ab51b42548e4 could not be found. May 31 21:14:02.544429 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:14:02.544429 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:14:02.544429 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:14:02.544429 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:14:02.544429 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:14:02.544429 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:14:02.544429 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 21:14:02.544429 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 21:14:02.544429 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 21:14:02.546020 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 21:14:02.546020 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 21:14:02.546020 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 21:14:02.546020 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 21:14:02.546020 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 21:14:02.546020 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 21:14:02.546020 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 21:14:02.546020 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d316a51-73db-479f-8449-ab51b42548e4 could not be found. May 31 21:14:02.546020 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:14:02.546020 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:14:02.546020 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:14:02.546020 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:14:02.546020 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:14:02.546020 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:14:02.546020 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 21:14:02.546020 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 21:14:02.546020 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d316a51-73db-479f-8449-ab51b42548e4 could not be found. May 31 21:14:02.546020 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:14:02.547414 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-b7c75f1a-8177-4bc4-b61b-21b52c8a20ce tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Returning 404 to user: Instance 1d316a51-73db-479f-8449-ab51b42548e4 could not be found. {{(pid=118184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 21:14:02.547414 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-b7c75f1a-8177-4bc4-b61b-21b52c8a20ce tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 404 len: 111 microversion: 2.20 time: 0.030890 May 31 21:14:02.547414 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 503/981] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:14:02 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 31 21:14:02.549021 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-e9914bf3-f4d7-47c6-a578-3c0724d348ad tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '.version_select at 0x7fe7c0dd0f70>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:14:02.645514 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-e9914bf3-f4d7-47c6-a578-3c0724d348ad tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-4258349" status: 204 len: 0 microversion: 2.20 time: 0.100255 May 31 21:14:02.646247 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 479/982] 10.222.0.55 () {60 vars in 1252 bytes} [Tue May 31 21:14:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-4258349 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 31 21:14:05.806318 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-a733f0b8-2cdd-47f8-8b7d-177fa3ba0c4a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:14:05.807702 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-a733f0b8-2cdd-47f8-8b7d-177fa3ba0c4a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:14:05.814645 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a733f0b8-2cdd-47f8-8b7d-177fa3ba0c4a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:14:05.815094 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a733f0b8-2cdd-47f8-8b7d-177fa3ba0c4a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:14:05.815862 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a733f0b8-2cdd-47f8-8b7d-177fa3ba0c4a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:14:05.816291 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a733f0b8-2cdd-47f8-8b7d-177fa3ba0c4a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:14:05.829924 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.wsgi [None req-a733f0b8-2cdd-47f8-8b7d-177fa3ba0c4a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] HTTP exception thrown: Instance 1d316a51-73db-479f-8449-ab51b42548e4 could not be found. May 31 21:14:05.832264 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-a733f0b8-2cdd-47f8-8b7d-177fa3ba0c4a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Request method failure captured: May 31 21:14:05.832264 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: request: DELETE /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 HTTP/1.1 May 31 21:14:05.832264 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Accept: application/json May 31 21:14:05.832264 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Accept-Encoding: identity May 31 21:14:05.832264 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Connection: close May 31 21:14:05.832264 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Content-Length: 0 May 31 21:14:05.832264 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Content-Type: application/json May 31 21:14:05.832264 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Host: 10.222.0.55 May 31 21:14:05.832264 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Openstack-System-Scope: None May 31 21:14:05.832264 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: User-Agent: python-urllib3/1.26.9 May 31 21:14:05.832264 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Auth-Token: gAAAAABiloKnJ_2lcEUHBtqGonwFAPKRN4u6Jj98V992qyB0RgFvh645yLhj_58i3K3xDrLOaAAGNimOespdwH_ZYG39Jef0nTIRBuLPvIp-1Cg1Jsm5xXNNM1pUdYoFw8vP7YFqBeGsVa011fgNOghwwGaORJ5Bk8xEcqBovJ_HNYR4r3OFkyg May 31 21:14:05.832264 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Domain-Id: None May 31 21:14:05.832264 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Domain-Name: None May 31 21:14:05.832264 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Identity-Status: Confirmed May 31 21:14:05.832264 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Is-Admin-Project: True May 31 21:14:05.832264 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Openstack-Nova-Api-Version: 2.20 May 31 21:14:05.832264 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Domain-Id: default May 31 21:14:05.832264 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Domain-Name: Default May 31 21:14:05.832264 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Id: af420d43367c42e4a4b0948706dd0546 May 31 21:14:05.832264 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-861773528 May 31 21:14:05.832264 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Role: member,reader May 31 21:14:05.832264 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Roles: member,reader May 31 21:14:05.833919 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/af420d43367c42e4a4b0948706dd0546"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/af420d43367c42e4a4b0948706dd0546"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_af420d43367c42e4a4b0948706dd0546", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/af420d43367c42e4a4b0948706dd0546"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] May 31 21:14:05.833919 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant: tempest-AttachVolumeShelveTestJSON-861773528 May 31 21:14:05.833919 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant-Id: af420d43367c42e4a4b0948706dd0546 May 31 21:14:05.833919 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-861773528 May 31 21:14:05.833919 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User: tempest-AttachVolumeShelveTestJSON-861773528-project May 31 21:14:05.833919 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Domain-Id: default May 31 21:14:05.833919 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Domain-Name: Default May 31 21:14:05.833919 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Id: 2d69edafe80649d4aff602b692e294c8 May 31 21:14:05.833919 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Name: tempest-AttachVolumeShelveTestJSON-861773528-project May 31 21:14:05.833919 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: method: > May 31 21:14:05.833919 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: exception: Instance 1d316a51-73db-479f-8449-ab51b42548e4 could not be found. May 31 21:14:05.833919 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: action_args: {'id': '1d316a51-73db-479f-8449-ab51b42548e4'} May 31 21:14:05.837840 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 21:14:05.837840 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:14:05.837840 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 21:14:05.837840 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 21:14:05.837840 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 21:14:05.837840 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 21:14:05.837840 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 21:14:05.837840 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 21:14:05.837840 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 21:14:05.837840 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 21:14:05.837840 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d316a51-73db-479f-8449-ab51b42548e4 could not be found. May 31 21:14:05.837840 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:14:05.837840 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:14:05.837840 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:14:05.837840 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:14:05.837840 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:14:05.837840 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:14:05.837840 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 21:14:05.837840 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 21:14:05.837840 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 21:14:05.839326 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 21:14:05.839326 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 31 21:14:05.839326 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 31 21:14:05.839326 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 31 21:14:05.839326 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 31 21:14:05.839326 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 21:14:05.839326 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 21:14:05.839326 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 21:14:05.839326 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 21:14:05.839326 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d316a51-73db-479f-8449-ab51b42548e4 could not be found. May 31 21:14:05.839326 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:14:05.839326 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:14:05.839326 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:14:05.839326 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:14:05.839326 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:14:05.839326 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:14:05.839326 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 21:14:05.839326 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 21:14:05.839326 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d316a51-73db-479f-8449-ab51b42548e4 could not be found. May 31 21:14:05.839326 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:14:05.840828 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-a733f0b8-2cdd-47f8-8b7d-177fa3ba0c4a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Returning 404 to user: Instance 1d316a51-73db-479f-8449-ab51b42548e4 could not be found. {{(pid=118184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 21:14:05.840828 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-a733f0b8-2cdd-47f8-8b7d-177fa3ba0c4a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "DELETE /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 404 len: 111 microversion: 2.20 time: 0.031622 May 31 21:14:05.840828 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 504/983] 10.222.0.55 () {60 vars in 1279 bytes} [Tue May 31 21:14:05 2022] DELETE /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 31 21:14:05.843225 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-c40de699-2b99-480b-bb30-fdd23e1dc302 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:14:05.843839 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-c40de699-2b99-480b-bb30-fdd23e1dc302 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: 1d316a51-73db-479f-8449-ab51b42548e4] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:14:05.851537 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c40de699-2b99-480b-bb30-fdd23e1dc302 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:14:05.852079 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c40de699-2b99-480b-bb30-fdd23e1dc302 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:14:05.852844 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c40de699-2b99-480b-bb30-fdd23e1dc302 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:14:05.853349 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c40de699-2b99-480b-bb30-fdd23e1dc302 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:14:05.866537 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.wsgi [None req-c40de699-2b99-480b-bb30-fdd23e1dc302 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] HTTP exception thrown: Instance 1d316a51-73db-479f-8449-ab51b42548e4 could not be found. May 31 21:14:05.868231 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-c40de699-2b99-480b-bb30-fdd23e1dc302 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Request method failure captured: May 31 21:14:05.868231 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: request: GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 HTTP/1.1 May 31 21:14:05.868231 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Accept: application/json May 31 21:14:05.868231 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Accept-Encoding: identity May 31 21:14:05.868231 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Connection: close May 31 21:14:05.868231 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Content-Length: 0 May 31 21:14:05.868231 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Content-Type: application/json May 31 21:14:05.868231 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Host: 10.222.0.55 May 31 21:14:05.868231 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Openstack-System-Scope: None May 31 21:14:05.868231 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: User-Agent: python-urllib3/1.26.9 May 31 21:14:05.868231 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Auth-Token: gAAAAABiloKnJ_2lcEUHBtqGonwFAPKRN4u6Jj98V992qyB0RgFvh645yLhj_58i3K3xDrLOaAAGNimOespdwH_ZYG39Jef0nTIRBuLPvIp-1Cg1Jsm5xXNNM1pUdYoFw8vP7YFqBeGsVa011fgNOghwwGaORJ5Bk8xEcqBovJ_HNYR4r3OFkyg May 31 21:14:05.868231 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Domain-Id: None May 31 21:14:05.868231 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Domain-Name: None May 31 21:14:05.868231 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Identity-Status: Confirmed May 31 21:14:05.868231 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Is-Admin-Project: True May 31 21:14:05.868231 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Openstack-Nova-Api-Version: 2.20 May 31 21:14:05.868231 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Domain-Id: default May 31 21:14:05.868231 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Domain-Name: Default May 31 21:14:05.868231 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Id: af420d43367c42e4a4b0948706dd0546 May 31 21:14:05.868231 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-861773528 May 31 21:14:05.868231 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Role: member,reader May 31 21:14:05.868231 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Roles: member,reader May 31 21:14:05.870083 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/af420d43367c42e4a4b0948706dd0546"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/af420d43367c42e4a4b0948706dd0546"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_af420d43367c42e4a4b0948706dd0546", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/af420d43367c42e4a4b0948706dd0546"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] May 31 21:14:05.870083 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant: tempest-AttachVolumeShelveTestJSON-861773528 May 31 21:14:05.870083 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant-Id: af420d43367c42e4a4b0948706dd0546 May 31 21:14:05.870083 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-861773528 May 31 21:14:05.870083 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User: tempest-AttachVolumeShelveTestJSON-861773528-project May 31 21:14:05.870083 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Domain-Id: default May 31 21:14:05.870083 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Domain-Name: Default May 31 21:14:05.870083 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Id: 2d69edafe80649d4aff602b692e294c8 May 31 21:14:05.870083 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Name: tempest-AttachVolumeShelveTestJSON-861773528-project May 31 21:14:05.870083 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: method: > May 31 21:14:05.870083 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: exception: Instance 1d316a51-73db-479f-8449-ab51b42548e4 could not be found. May 31 21:14:05.870083 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: action_args: {'id': '1d316a51-73db-479f-8449-ab51b42548e4'} May 31 21:14:05.872306 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 21:14:05.872306 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:14:05.872306 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 21:14:05.872306 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 21:14:05.872306 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 21:14:05.872306 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 21:14:05.872306 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 21:14:05.872306 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 21:14:05.872306 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 21:14:05.872306 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 21:14:05.872306 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d316a51-73db-479f-8449-ab51b42548e4 could not be found. May 31 21:14:05.872306 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:14:05.872306 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:14:05.872306 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:14:05.872306 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:14:05.872306 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:14:05.872306 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:14:05.872306 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 21:14:05.872306 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 21:14:05.872306 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 21:14:05.873709 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 21:14:05.873709 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 21:14:05.873709 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 21:14:05.873709 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 21:14:05.873709 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 21:14:05.873709 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 21:14:05.873709 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 21:14:05.873709 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d316a51-73db-479f-8449-ab51b42548e4 could not be found. May 31 21:14:05.873709 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:14:05.873709 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:14:05.873709 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:14:05.873709 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:14:05.873709 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:14:05.873709 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:14:05.873709 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 21:14:05.873709 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 21:14:05.873709 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d316a51-73db-479f-8449-ab51b42548e4 could not be found. May 31 21:14:05.873709 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:14:05.875131 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-c40de699-2b99-480b-bb30-fdd23e1dc302 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Returning 404 to user: Instance 1d316a51-73db-479f-8449-ab51b42548e4 could not be found. {{(pid=118185) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 21:14:05.875131 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-c40de699-2b99-480b-bb30-fdd23e1dc302 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4" status: 404 len: 111 microversion: 2.20 time: 0.031153 May 31 21:14:05.875131 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 480/984] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:14:05 2022] GET /compute/v2.1/servers/1d316a51-73db-479f-8449-ab51b42548e4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 31 21:14:06.247963 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-50d1dc78-a291-4844-8812-2d2daed8836a tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1995293071", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1276431592", "security_groups": [{"name": "tempest-secgroup-smoke-506263611"}], "block_device_mapping_v2": [{"uuid": "58ebf596-936d-46e4-9d6d-01bfe3c2c5cd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2c2f81e7-9a7d-4701-bf43-a528a17f585a"}]}} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:14:06.366134 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.network.neutron [None req-50d1dc78-a291-4844-8812-2d2daed8836a tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] validate_networks() for [('2c2f81e7-9a7d-4701-bf43-a528a17f585a', None, None, None, None, None)] {{(pid=118184) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 21:14:06.769887 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.virt.hardware [None req-50d1dc78-a291-4844-8812-2d2daed8836a tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Flavor limits 0:0:0 {{(pid=118184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 21:14:06.770780 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.virt.hardware [None req-50d1dc78-a291-4844-8812-2d2daed8836a tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Image limits 0:0:0 {{(pid=118184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 21:14:06.771146 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.virt.hardware [None req-50d1dc78-a291-4844-8812-2d2daed8836a tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Flavor pref 0:0:0 {{(pid=118184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 21:14:06.773008 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.virt.hardware [None req-50d1dc78-a291-4844-8812-2d2daed8836a tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Image pref 0:0:0 {{(pid=118184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 21:14:06.773008 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.virt.hardware [None req-50d1dc78-a291-4844-8812-2d2daed8836a tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 21:14:06.781236 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-50d1dc78-a291-4844-8812-2d2daed8836a tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:14:06.781679 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-50d1dc78-a291-4844-8812-2d2daed8836a tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:14:06.782577 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-50d1dc78-a291-4844-8812-2d2daed8836a tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:14:06.783020 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-50d1dc78-a291-4844-8812-2d2daed8836a tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:14:06.802418 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.quota [None req-50d1dc78-a291-4844-8812-2d2daed8836a tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Getting quotas for project 8e511490c0f8438fb89ac590bd63529f. Resources: {'ram', 'cores', 'instances'} {{(pid=118184) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 21:14:06.806466 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.quota [None req-50d1dc78-a291-4844-8812-2d2daed8836a tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Getting quotas for user 546cd066c4244bffacbfea21f5e4f437 and project 8e511490c0f8438fb89ac590bd63529f. Resources: {'ram', 'cores', 'instances'} {{(pid=118184) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 21:14:06.867021 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-50d1dc78-a291-4844-8812-2d2daed8836a tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Going to run 1 instances... {{(pid=118184) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 21:14:06.869239 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-50d1dc78-a291-4844-8812-2d2daed8836a tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 1cb3ce1b-f994-4a4b-9f06-12a001fcd081] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='58ebf596-936d-46e4-9d6d-01bfe3c2c5cd',volume_size=None,volume_type=None)] {{(pid=118184) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 21:14:07.171982 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-61ec6e9a-e325-44e3-8c62-b6ec71831b4a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:14:07.172538 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-61ec6e9a-e325-44e3-8c62-b6ec71831b4a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:14:07.178873 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-61ec6e9a-e325-44e3-8c62-b6ec71831b4a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:14:07.179326 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-61ec6e9a-e325-44e3-8c62-b6ec71831b4a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:14:07.180103 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-61ec6e9a-e325-44e3-8c62-b6ec71831b4a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:14:07.180543 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-61ec6e9a-e325-44e3-8c62-b6ec71831b4a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:14:07.194172 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.wsgi [None req-61ec6e9a-e325-44e3-8c62-b6ec71831b4a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] HTTP exception thrown: Instance a123764b-4693-41b1-bad8-a1a63cc951cd could not be found. May 31 21:14:07.195758 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-61ec6e9a-e325-44e3-8c62-b6ec71831b4a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Request method failure captured: May 31 21:14:07.195758 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: request: DELETE /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd HTTP/1.1 May 31 21:14:07.195758 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Accept: application/json May 31 21:14:07.195758 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Accept-Encoding: identity May 31 21:14:07.195758 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Connection: close May 31 21:14:07.195758 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Content-Length: 0 May 31 21:14:07.195758 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Content-Type: application/json May 31 21:14:07.195758 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Host: 10.222.0.55 May 31 21:14:07.195758 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Openstack-System-Scope: None May 31 21:14:07.195758 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: User-Agent: python-urllib3/1.26.9 May 31 21:14:07.195758 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Auth-Token: gAAAAABiloKnJ_2lcEUHBtqGonwFAPKRN4u6Jj98V992qyB0RgFvh645yLhj_58i3K3xDrLOaAAGNimOespdwH_ZYG39Jef0nTIRBuLPvIp-1Cg1Jsm5xXNNM1pUdYoFw8vP7YFqBeGsVa011fgNOghwwGaORJ5Bk8xEcqBovJ_HNYR4r3OFkyg May 31 21:14:07.195758 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Domain-Id: None May 31 21:14:07.195758 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Domain-Name: None May 31 21:14:07.195758 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Identity-Status: Confirmed May 31 21:14:07.195758 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Is-Admin-Project: True May 31 21:14:07.195758 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Openstack-Nova-Api-Version: 2.20 May 31 21:14:07.195758 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Domain-Id: default May 31 21:14:07.195758 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Domain-Name: Default May 31 21:14:07.195758 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Id: af420d43367c42e4a4b0948706dd0546 May 31 21:14:07.195758 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-861773528 May 31 21:14:07.195758 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Role: member,reader May 31 21:14:07.195758 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Roles: member,reader May 31 21:14:07.197499 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/af420d43367c42e4a4b0948706dd0546"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/af420d43367c42e4a4b0948706dd0546"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_af420d43367c42e4a4b0948706dd0546", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/af420d43367c42e4a4b0948706dd0546"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] May 31 21:14:07.197499 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant: tempest-AttachVolumeShelveTestJSON-861773528 May 31 21:14:07.197499 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant-Id: af420d43367c42e4a4b0948706dd0546 May 31 21:14:07.197499 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-861773528 May 31 21:14:07.197499 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User: tempest-AttachVolumeShelveTestJSON-861773528-project May 31 21:14:07.197499 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Domain-Id: default May 31 21:14:07.197499 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Domain-Name: Default May 31 21:14:07.197499 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Id: 2d69edafe80649d4aff602b692e294c8 May 31 21:14:07.197499 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Name: tempest-AttachVolumeShelveTestJSON-861773528-project May 31 21:14:07.197499 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: method: > May 31 21:14:07.197499 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: exception: Instance a123764b-4693-41b1-bad8-a1a63cc951cd could not be found. May 31 21:14:07.197499 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: action_args: {'id': 'a123764b-4693-41b1-bad8-a1a63cc951cd'} May 31 21:14:07.198338 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 21:14:07.198338 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:14:07.198338 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 21:14:07.198338 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 21:14:07.198338 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 21:14:07.198338 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 21:14:07.198338 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 21:14:07.198338 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 21:14:07.198338 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 21:14:07.198338 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 21:14:07.198338 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a123764b-4693-41b1-bad8-a1a63cc951cd could not be found. May 31 21:14:07.198338 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:14:07.198338 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:14:07.198338 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:14:07.198338 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:14:07.198338 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:14:07.198338 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:14:07.198338 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 21:14:07.198338 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 21:14:07.198338 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 21:14:07.199567 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 21:14:07.199567 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 31 21:14:07.199567 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 31 21:14:07.199567 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 31 21:14:07.199567 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 31 21:14:07.199567 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 21:14:07.199567 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 21:14:07.199567 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 21:14:07.199567 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 21:14:07.199567 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a123764b-4693-41b1-bad8-a1a63cc951cd could not be found. May 31 21:14:07.199567 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:14:07.199567 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:14:07.199567 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:14:07.199567 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:14:07.199567 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:14:07.199567 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:14:07.199567 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 21:14:07.199567 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 21:14:07.199567 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a123764b-4693-41b1-bad8-a1a63cc951cd could not be found. May 31 21:14:07.199567 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:14:07.200805 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-61ec6e9a-e325-44e3-8c62-b6ec71831b4a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Returning 404 to user: Instance a123764b-4693-41b1-bad8-a1a63cc951cd could not be found. {{(pid=118185) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 21:14:07.200805 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-61ec6e9a-e325-44e3-8c62-b6ec71831b4a tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "DELETE /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 404 len: 111 microversion: 2.20 time: 0.029105 May 31 21:14:07.200805 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 481/985] 10.222.0.55 () {60 vars in 1279 bytes} [Tue May 31 21:14:07 2022] DELETE /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 31 21:14:07.205719 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-b6690d53-43b4-4f5e-8b38-99ab751c4814 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:14:07.206995 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-b6690d53-43b4-4f5e-8b38-99ab751c4814 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] [instance: a123764b-4693-41b1-bad8-a1a63cc951cd] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:14:07.213617 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b6690d53-43b4-4f5e-8b38-99ab751c4814 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:14:07.213617 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b6690d53-43b4-4f5e-8b38-99ab751c4814 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:14:07.217976 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b6690d53-43b4-4f5e-8b38-99ab751c4814 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:14:07.217976 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b6690d53-43b4-4f5e-8b38-99ab751c4814 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:14:07.229882 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.wsgi [None req-b6690d53-43b4-4f5e-8b38-99ab751c4814 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] HTTP exception thrown: Instance a123764b-4693-41b1-bad8-a1a63cc951cd could not be found. May 31 21:14:07.231471 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-b6690d53-43b4-4f5e-8b38-99ab751c4814 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Request method failure captured: May 31 21:14:07.231471 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: request: GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd HTTP/1.1 May 31 21:14:07.231471 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Accept: application/json May 31 21:14:07.231471 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Accept-Encoding: identity May 31 21:14:07.231471 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Connection: close May 31 21:14:07.231471 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Content-Length: 0 May 31 21:14:07.231471 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Content-Type: application/json May 31 21:14:07.231471 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Host: 10.222.0.55 May 31 21:14:07.231471 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Openstack-System-Scope: None May 31 21:14:07.231471 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: User-Agent: python-urllib3/1.26.9 May 31 21:14:07.231471 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Auth-Token: gAAAAABiloKnJ_2lcEUHBtqGonwFAPKRN4u6Jj98V992qyB0RgFvh645yLhj_58i3K3xDrLOaAAGNimOespdwH_ZYG39Jef0nTIRBuLPvIp-1Cg1Jsm5xXNNM1pUdYoFw8vP7YFqBeGsVa011fgNOghwwGaORJ5Bk8xEcqBovJ_HNYR4r3OFkyg May 31 21:14:07.231471 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Domain-Id: None May 31 21:14:07.231471 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Domain-Name: None May 31 21:14:07.231471 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Identity-Status: Confirmed May 31 21:14:07.231471 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Is-Admin-Project: True May 31 21:14:07.231471 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Openstack-Nova-Api-Version: 2.20 May 31 21:14:07.231471 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Domain-Id: default May 31 21:14:07.231471 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Domain-Name: Default May 31 21:14:07.231471 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Id: af420d43367c42e4a4b0948706dd0546 May 31 21:14:07.231471 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-861773528 May 31 21:14:07.231471 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Role: member,reader May 31 21:14:07.231471 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Roles: member,reader May 31 21:14:07.233199 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/af420d43367c42e4a4b0948706dd0546"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/af420d43367c42e4a4b0948706dd0546"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_af420d43367c42e4a4b0948706dd0546", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/af420d43367c42e4a4b0948706dd0546"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] May 31 21:14:07.233199 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant: tempest-AttachVolumeShelveTestJSON-861773528 May 31 21:14:07.233199 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant-Id: af420d43367c42e4a4b0948706dd0546 May 31 21:14:07.233199 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-861773528 May 31 21:14:07.233199 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User: tempest-AttachVolumeShelveTestJSON-861773528-project May 31 21:14:07.233199 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Domain-Id: default May 31 21:14:07.233199 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Domain-Name: Default May 31 21:14:07.233199 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Id: 2d69edafe80649d4aff602b692e294c8 May 31 21:14:07.233199 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Name: tempest-AttachVolumeShelveTestJSON-861773528-project May 31 21:14:07.233199 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: method: > May 31 21:14:07.233199 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: exception: Instance a123764b-4693-41b1-bad8-a1a63cc951cd could not be found. May 31 21:14:07.233199 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: action_args: {'id': 'a123764b-4693-41b1-bad8-a1a63cc951cd'} May 31 21:14:07.234120 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 21:14:07.234120 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:14:07.234120 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 21:14:07.234120 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 21:14:07.234120 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 21:14:07.234120 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 21:14:07.234120 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 21:14:07.234120 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 21:14:07.234120 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 21:14:07.234120 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 21:14:07.234120 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a123764b-4693-41b1-bad8-a1a63cc951cd could not be found. May 31 21:14:07.234120 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:14:07.234120 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:14:07.234120 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:14:07.234120 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:14:07.234120 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:14:07.234120 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:14:07.234120 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 21:14:07.234120 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 21:14:07.234120 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 21:14:07.235746 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 21:14:07.235746 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 21:14:07.235746 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 21:14:07.235746 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 21:14:07.235746 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 21:14:07.235746 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 21:14:07.235746 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 21:14:07.235746 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a123764b-4693-41b1-bad8-a1a63cc951cd could not be found. May 31 21:14:07.235746 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:14:07.235746 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:14:07.235746 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:14:07.235746 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:14:07.235746 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:14:07.235746 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:14:07.235746 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 21:14:07.235746 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 21:14:07.235746 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a123764b-4693-41b1-bad8-a1a63cc951cd could not be found. May 31 21:14:07.235746 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:14:07.237032 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-b6690d53-43b4-4f5e-8b38-99ab751c4814 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] Returning 404 to user: Instance a123764b-4693-41b1-bad8-a1a63cc951cd could not be found. {{(pid=118185) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 21:14:07.237032 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-b6690d53-43b4-4f5e-8b38-99ab751c4814 tempest-AttachVolumeShelveTestJSON-861773528 tempest-AttachVolumeShelveTestJSON-861773528-project] 10.222.0.55 "GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd" status: 404 len: 111 microversion: 2.20 time: 0.031092 May 31 21:14:07.237032 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 482/986] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 31 21:14:07 2022] GET /compute/v2.1/servers/a123764b-4693-41b1-bad8-a1a63cc951cd => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 31 21:14:07.260045 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-50d1dc78-a291-4844-8812-2d2daed8836a tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.016059 May 31 21:14:07.261309 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 505/987] 10.222.0.55 () {60 vars in 1146 bytes} [Tue May 31 21:14:06 2022] POST /compute/v2.1/servers => generated 405 bytes in 1017 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 31 21:14:07.272056 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-a1081bd7-49e0-479c-8a61-894afc9b5030 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:14:07.273153 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-a1081bd7-49e0-479c-8a61-894afc9b5030 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 1cb3ce1b-f994-4a4b-9f06-12a001fcd081] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:14:07.358289 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-a1081bd7-49e0-479c-8a61-894afc9b5030 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:14:07.369610 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-a1081bd7-49e0-479c-8a61-894afc9b5030 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/1cb3ce1b-f994-4a4b-9f06-12a001fcd081" status: 200 len: 1095 microversion: 2.1 time: 0.101256 May 31 21:14:07.379196 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 483/988] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:14:07 2022] GET /compute/v2.1/servers/1cb3ce1b-f994-4a4b-9f06-12a001fcd081 => generated 1095 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:14:08.387317 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-0912e3e1-c4de-462e-a286-b171c8e0d1ef tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:14:08.387939 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-0912e3e1-c4de-462e-a286-b171c8e0d1ef tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 1cb3ce1b-f994-4a4b-9f06-12a001fcd081] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:14:08.396447 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-0912e3e1-c4de-462e-a286-b171c8e0d1ef tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:14:08.396896 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-0912e3e1-c4de-462e-a286-b171c8e0d1ef tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:14:08.397713 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-0912e3e1-c4de-462e-a286-b171c8e0d1ef tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:14:08.398147 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-0912e3e1-c4de-462e-a286-b171c8e0d1ef tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:14:08.480216 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-0912e3e1-c4de-462e-a286-b171c8e0d1ef tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:14:08.488198 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-0912e3e1-c4de-462e-a286-b171c8e0d1ef tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/1cb3ce1b-f994-4a4b-9f06-12a001fcd081" status: 200 len: 1145 microversion: 2.1 time: 0.105109 May 31 21:14:08.491704 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 506/989] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:14:08 2022] GET /compute/v2.1/servers/1cb3ce1b-f994-4a4b-9f06-12a001fcd081 => generated 1145 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:14:09.509520 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-d7088c0f-9858-4e90-8d3a-54dc4458851a tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:14:09.510281 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-d7088c0f-9858-4e90-8d3a-54dc4458851a tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 1cb3ce1b-f994-4a4b-9f06-12a001fcd081] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:14:09.523551 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-d7088c0f-9858-4e90-8d3a-54dc4458851a tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:14:09.526127 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-d7088c0f-9858-4e90-8d3a-54dc4458851a tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:14:09.527391 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-d7088c0f-9858-4e90-8d3a-54dc4458851a tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:14:09.528107 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-d7088c0f-9858-4e90-8d3a-54dc4458851a tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:14:09.634220 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-d7088c0f-9858-4e90-8d3a-54dc4458851a tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:14:09.645688 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-d7088c0f-9858-4e90-8d3a-54dc4458851a tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/1cb3ce1b-f994-4a4b-9f06-12a001fcd081" status: 200 len: 1201 microversion: 2.1 time: 0.143185 May 31 21:14:09.646436 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 484/990] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:14:09 2022] GET /compute/v2.1/servers/1cb3ce1b-f994-4a4b-9f06-12a001fcd081 => generated 1201 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:14:10.664527 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-5e196020-5845-4cfd-8025-638451f79a38 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:14:10.666085 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-5e196020-5845-4cfd-8025-638451f79a38 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 1cb3ce1b-f994-4a4b-9f06-12a001fcd081] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:14:10.678284 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5e196020-5845-4cfd-8025-638451f79a38 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:14:10.678838 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5e196020-5845-4cfd-8025-638451f79a38 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:14:10.681348 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5e196020-5845-4cfd-8025-638451f79a38 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:14:10.681873 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5e196020-5845-4cfd-8025-638451f79a38 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:14:11.006426 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-5e196020-5845-4cfd-8025-638451f79a38 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:14:11.014378 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-5e196020-5845-4cfd-8025-638451f79a38 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/1cb3ce1b-f994-4a4b-9f06-12a001fcd081" status: 200 len: 1278 microversion: 2.1 time: 0.354725 May 31 21:14:11.034917 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 507/991] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:14:10 2022] GET /compute/v2.1/servers/1cb3ce1b-f994-4a4b-9f06-12a001fcd081 => generated 1278 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:14:11.776325 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [req-c8e8d87d-899e-4c12-ae4c-66f9739c645e req-83d49217-872e-4c12-8d6b-74fd09225d0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cb3ce1b-f994-4a4b-9f06-12a001fcd081", "tag": "b6ddeae7-2540-4694-af04-5e45ce14eb5e"}]} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:14:11.798620 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-c8e8d87d-899e-4c12-ae4c-66f9739c645e req-83d49217-872e-4c12-8d6b-74fd09225d0f service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:14:11.799508 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-c8e8d87d-899e-4c12-ae4c-66f9739c645e req-83d49217-872e-4c12-8d6b-74fd09225d0f service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:14:11.813660 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.compute.server_external_events [req-c8e8d87d-899e-4c12-ae4c-66f9739c645e req-83d49217-872e-4c12-8d6b-74fd09225d0f service nova] Creating event network-changed:b6ddeae7-2540-4694-af04-5e45ce14eb5e for instance 1cb3ce1b-f994-4a4b-9f06-12a001fcd081 on hv-cinder-83979 May 31 21:14:11.822763 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [req-c8e8d87d-899e-4c12-ae4c-66f9739c645e req-83d49217-872e-4c12-8d6b-74fd09225d0f service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049973 May 31 21:14:11.823764 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 485/992] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 21:14:12.035983 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-bd78fa6b-a348-4a7d-b5f5-2175c30f7425 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:14:12.037187 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-bd78fa6b-a348-4a7d-b5f5-2175c30f7425 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 1cb3ce1b-f994-4a4b-9f06-12a001fcd081] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:14:12.044232 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-bd78fa6b-a348-4a7d-b5f5-2175c30f7425 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:14:12.044685 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-bd78fa6b-a348-4a7d-b5f5-2175c30f7425 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:14:12.045451 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-bd78fa6b-a348-4a7d-b5f5-2175c30f7425 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:14:12.045883 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-bd78fa6b-a348-4a7d-b5f5-2175c30f7425 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:14:12.215514 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-bd78fa6b-a348-4a7d-b5f5-2175c30f7425 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:14:12.224047 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-bd78fa6b-a348-4a7d-b5f5-2175c30f7425 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/1cb3ce1b-f994-4a4b-9f06-12a001fcd081" status: 200 len: 1266 microversion: 2.1 time: 0.193107 May 31 21:14:12.224848 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 508/993] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:14:12 2022] GET /compute/v2.1/servers/1cb3ce1b-f994-4a4b-9f06-12a001fcd081 => generated 1266 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:14:13.242376 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-b8a7166e-ab25-49d1-97b5-d6f9f5e0b463 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:14:13.243069 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-b8a7166e-ab25-49d1-97b5-d6f9f5e0b463 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 1cb3ce1b-f994-4a4b-9f06-12a001fcd081] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:14:13.251999 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b8a7166e-ab25-49d1-97b5-d6f9f5e0b463 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:14:13.251999 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b8a7166e-ab25-49d1-97b5-d6f9f5e0b463 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:14:13.251999 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b8a7166e-ab25-49d1-97b5-d6f9f5e0b463 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:14:13.251999 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b8a7166e-ab25-49d1-97b5-d6f9f5e0b463 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:14:13.404719 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-b8a7166e-ab25-49d1-97b5-d6f9f5e0b463 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:14:13.412776 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-b8a7166e-ab25-49d1-97b5-d6f9f5e0b463 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/1cb3ce1b-f994-4a4b-9f06-12a001fcd081" status: 200 len: 1266 microversion: 2.1 time: 0.175767 May 31 21:14:13.413471 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 486/994] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:14:13 2022] GET /compute/v2.1/servers/1cb3ce1b-f994-4a4b-9f06-12a001fcd081 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:14:14.429761 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-81d85891-7430-418e-91cd-b7ad340fa316 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:14:14.430408 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-81d85891-7430-418e-91cd-b7ad340fa316 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 1cb3ce1b-f994-4a4b-9f06-12a001fcd081] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:14:14.436584 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-81d85891-7430-418e-91cd-b7ad340fa316 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:14:14.437700 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-81d85891-7430-418e-91cd-b7ad340fa316 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:14:14.437975 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-81d85891-7430-418e-91cd-b7ad340fa316 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:14:14.438257 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-81d85891-7430-418e-91cd-b7ad340fa316 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:14:14.573503 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-81d85891-7430-418e-91cd-b7ad340fa316 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:14:14.582007 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-81d85891-7430-418e-91cd-b7ad340fa316 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/1cb3ce1b-f994-4a4b-9f06-12a001fcd081" status: 200 len: 1266 microversion: 2.1 time: 0.155424 May 31 21:14:14.582585 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 509/995] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:14:14 2022] GET /compute/v2.1/servers/1cb3ce1b-f994-4a4b-9f06-12a001fcd081 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:14:15.598425 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-7ff90d8b-30d3-4696-87cb-63a17d6f2aa3 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:14:15.599050 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-7ff90d8b-30d3-4696-87cb-63a17d6f2aa3 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 1cb3ce1b-f994-4a4b-9f06-12a001fcd081] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:14:15.605675 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-7ff90d8b-30d3-4696-87cb-63a17d6f2aa3 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:14:15.606166 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-7ff90d8b-30d3-4696-87cb-63a17d6f2aa3 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:14:15.607016 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-7ff90d8b-30d3-4696-87cb-63a17d6f2aa3 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:14:15.607388 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-7ff90d8b-30d3-4696-87cb-63a17d6f2aa3 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:14:15.777691 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-7ff90d8b-30d3-4696-87cb-63a17d6f2aa3 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:14:15.785447 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-7ff90d8b-30d3-4696-87cb-63a17d6f2aa3 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/1cb3ce1b-f994-4a4b-9f06-12a001fcd081" status: 200 len: 1266 microversion: 2.1 time: 0.191438 May 31 21:14:15.797202 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 487/996] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:14:15 2022] GET /compute/v2.1/servers/1cb3ce1b-f994-4a4b-9f06-12a001fcd081 => generated 1266 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:14:16.812309 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-cabb250a-c357-4c70-9a1d-bf0b6fb81485 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:14:16.812911 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-cabb250a-c357-4c70-9a1d-bf0b6fb81485 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 1cb3ce1b-f994-4a4b-9f06-12a001fcd081] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:14:16.816414 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell0:SELECT=2 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:14:16.817772 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell0:SELECT=6 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:14:16.821598 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-cabb250a-c357-4c70-9a1d-bf0b6fb81485 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:14:16.821975 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-cabb250a-c357-4c70-9a1d-bf0b6fb81485 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:14:16.822735 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-cabb250a-c357-4c70-9a1d-bf0b6fb81485 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:14:16.823163 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-cabb250a-c357-4c70-9a1d-bf0b6fb81485 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:14:16.966013 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-cabb250a-c357-4c70-9a1d-bf0b6fb81485 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:14:16.974749 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-cabb250a-c357-4c70-9a1d-bf0b6fb81485 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/1cb3ce1b-f994-4a4b-9f06-12a001fcd081" status: 200 len: 1266 microversion: 2.1 time: 0.166299 May 31 21:14:16.975352 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 510/997] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:14:16 2022] GET /compute/v2.1/servers/1cb3ce1b-f994-4a4b-9f06-12a001fcd081 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:14:17.991355 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-942186e6-a356-410a-9673-c227636be012 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:14:17.991970 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-942186e6-a356-410a-9673-c227636be012 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 1cb3ce1b-f994-4a4b-9f06-12a001fcd081] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:14:17.994497 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell0:SELECT=2 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:14:17.999381 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-942186e6-a356-410a-9673-c227636be012 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:14:18.003606 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-942186e6-a356-410a-9673-c227636be012 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:14:18.003606 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-942186e6-a356-410a-9673-c227636be012 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:14:18.003606 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-942186e6-a356-410a-9673-c227636be012 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:14:18.140058 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-942186e6-a356-410a-9673-c227636be012 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:14:18.148532 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-942186e6-a356-410a-9673-c227636be012 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/1cb3ce1b-f994-4a4b-9f06-12a001fcd081" status: 200 len: 1266 microversion: 2.1 time: 0.161381 May 31 21:14:18.149144 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 488/998] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:14:17 2022] GET /compute/v2.1/servers/1cb3ce1b-f994-4a4b-9f06-12a001fcd081 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:14:19.166411 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-582a6630-d3fc-425d-a1aa-36248595160c tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:14:19.167018 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-582a6630-d3fc-425d-a1aa-36248595160c tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 1cb3ce1b-f994-4a4b-9f06-12a001fcd081] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:14:19.174060 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-582a6630-d3fc-425d-a1aa-36248595160c tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:14:19.174626 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-582a6630-d3fc-425d-a1aa-36248595160c tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:14:19.175412 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-582a6630-d3fc-425d-a1aa-36248595160c tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:14:19.175877 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-582a6630-d3fc-425d-a1aa-36248595160c tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:14:19.319713 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-582a6630-d3fc-425d-a1aa-36248595160c tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:14:19.327768 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-582a6630-d3fc-425d-a1aa-36248595160c tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/1cb3ce1b-f994-4a4b-9f06-12a001fcd081" status: 200 len: 1266 microversion: 2.1 time: 0.165262 May 31 21:14:19.332982 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 511/999] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:14:19 2022] GET /compute/v2.1/servers/1cb3ce1b-f994-4a4b-9f06-12a001fcd081 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:14:20.344684 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-94b2fb7d-f090-4073-b5eb-48de1eb5f399 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:14:20.345294 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-94b2fb7d-f090-4073-b5eb-48de1eb5f399 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 1cb3ce1b-f994-4a4b-9f06-12a001fcd081] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:14:20.352408 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-94b2fb7d-f090-4073-b5eb-48de1eb5f399 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:14:20.352858 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-94b2fb7d-f090-4073-b5eb-48de1eb5f399 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:14:20.353639 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-94b2fb7d-f090-4073-b5eb-48de1eb5f399 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:14:20.354450 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-94b2fb7d-f090-4073-b5eb-48de1eb5f399 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:14:20.486146 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-94b2fb7d-f090-4073-b5eb-48de1eb5f399 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:14:20.494296 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-94b2fb7d-f090-4073-b5eb-48de1eb5f399 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/1cb3ce1b-f994-4a4b-9f06-12a001fcd081" status: 200 len: 1266 microversion: 2.1 time: 0.153268 May 31 21:14:20.494924 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 489/1000] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:14:20 2022] GET /compute/v2.1/servers/1cb3ce1b-f994-4a4b-9f06-12a001fcd081 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:14:21.510747 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-d87facca-f002-4e16-be81-e02890271a41 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:14:21.511385 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-d87facca-f002-4e16-be81-e02890271a41 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 1cb3ce1b-f994-4a4b-9f06-12a001fcd081] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:14:21.517981 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d87facca-f002-4e16-be81-e02890271a41 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:14:21.518933 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d87facca-f002-4e16-be81-e02890271a41 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:14:21.520312 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d87facca-f002-4e16-be81-e02890271a41 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:14:21.520752 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d87facca-f002-4e16-be81-e02890271a41 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:14:21.657038 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-d87facca-f002-4e16-be81-e02890271a41 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:14:21.665591 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-d87facca-f002-4e16-be81-e02890271a41 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/1cb3ce1b-f994-4a4b-9f06-12a001fcd081" status: 200 len: 1266 microversion: 2.1 time: 0.158645 May 31 21:14:21.666217 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 512/1001] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:14:21 2022] GET /compute/v2.1/servers/1cb3ce1b-f994-4a4b-9f06-12a001fcd081 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:14:22.682030 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-ef9f651e-889a-411c-8b81-f521701a7a7c tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:14:22.682647 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-ef9f651e-889a-411c-8b81-f521701a7a7c tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 1cb3ce1b-f994-4a4b-9f06-12a001fcd081] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:14:22.694703 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ef9f651e-889a-411c-8b81-f521701a7a7c tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:14:22.694703 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ef9f651e-889a-411c-8b81-f521701a7a7c tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:14:22.694703 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ef9f651e-889a-411c-8b81-f521701a7a7c tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:14:22.694703 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ef9f651e-889a-411c-8b81-f521701a7a7c tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:14:22.823348 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-ef9f651e-889a-411c-8b81-f521701a7a7c tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:14:22.831076 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-ef9f651e-889a-411c-8b81-f521701a7a7c tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/1cb3ce1b-f994-4a4b-9f06-12a001fcd081" status: 200 len: 1266 microversion: 2.1 time: 0.152947 May 31 21:14:22.831647 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 490/1002] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:14:22 2022] GET /compute/v2.1/servers/1cb3ce1b-f994-4a4b-9f06-12a001fcd081 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:14:23.827015 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [req-a08b5f57-2a04-4426-b908-a6e0dcc54fa3 req-0844bae4-da9f-45f1-b3e8-152086ffa4d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cb3ce1b-f994-4a4b-9f06-12a001fcd081", "name": "network-vif-plugged", "status": "completed", "tag": "b6ddeae7-2540-4694-af04-5e45ce14eb5e"}]} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:14:23.836532 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-a08b5f57-2a04-4426-b908-a6e0dcc54fa3 req-0844bae4-da9f-45f1-b3e8-152086ffa4d6 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:14:23.836972 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-a08b5f57-2a04-4426-b908-a6e0dcc54fa3 req-0844bae4-da9f-45f1-b3e8-152086ffa4d6 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:14:23.848966 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.compute.server_external_events [req-a08b5f57-2a04-4426-b908-a6e0dcc54fa3 req-0844bae4-da9f-45f1-b3e8-152086ffa4d6 service nova] Creating event network-vif-plugged:b6ddeae7-2540-4694-af04-5e45ce14eb5e for instance 1cb3ce1b-f994-4a4b-9f06-12a001fcd081 on hv-cinder-83979 May 31 21:14:23.849206 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-c2424fd4-8f3c-44bb-8208-56d652b76c82 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:14:23.849753 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-c2424fd4-8f3c-44bb-8208-56d652b76c82 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 1cb3ce1b-f994-4a4b-9f06-12a001fcd081] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:14:23.854454 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [req-a08b5f57-2a04-4426-b908-a6e0dcc54fa3 req-0844bae4-da9f-45f1-b3e8-152086ffa4d6 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151272 May 31 21:14:23.855170 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 513/1003] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:14:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:14:23.856936 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c2424fd4-8f3c-44bb-8208-56d652b76c82 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:14:23.857396 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c2424fd4-8f3c-44bb-8208-56d652b76c82 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:14:23.858205 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c2424fd4-8f3c-44bb-8208-56d652b76c82 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:14:23.858645 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c2424fd4-8f3c-44bb-8208-56d652b76c82 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:14:23.997167 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-c2424fd4-8f3c-44bb-8208-56d652b76c82 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:14:24.005160 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-c2424fd4-8f3c-44bb-8208-56d652b76c82 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/1cb3ce1b-f994-4a4b-9f06-12a001fcd081" status: 200 len: 1266 microversion: 2.1 time: 0.160475 May 31 21:14:24.005730 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 491/1004] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:14:23 2022] GET /compute/v2.1/servers/1cb3ce1b-f994-4a4b-9f06-12a001fcd081 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:14:25.025927 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-ba7bdfa8-4af2-4b81-b2c3-d55c87a1ca7f tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:14:25.026765 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-ba7bdfa8-4af2-4b81-b2c3-d55c87a1ca7f tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 1cb3ce1b-f994-4a4b-9f06-12a001fcd081] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:14:25.031779 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:14:25.035411 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ba7bdfa8-4af2-4b81-b2c3-d55c87a1ca7f tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:14:25.035411 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ba7bdfa8-4af2-4b81-b2c3-d55c87a1ca7f tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:14:25.035411 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ba7bdfa8-4af2-4b81-b2c3-d55c87a1ca7f tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:14:25.035738 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ba7bdfa8-4af2-4b81-b2c3-d55c87a1ca7f tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:14:25.039666 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell1:SELECT=77 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:14:25.174455 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-ba7bdfa8-4af2-4b81-b2c3-d55c87a1ca7f tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:14:25.185815 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-ba7bdfa8-4af2-4b81-b2c3-d55c87a1ca7f tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/1cb3ce1b-f994-4a4b-9f06-12a001fcd081" status: 200 len: 1266 microversion: 2.1 time: 0.164570 May 31 21:14:25.186863 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 514/1005] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:14:25 2022] GET /compute/v2.1/servers/1cb3ce1b-f994-4a4b-9f06-12a001fcd081 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:14:26.203583 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-bc01b0ce-ca5c-4ea7-913d-13fef6bca657 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:14:26.204328 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-bc01b0ce-ca5c-4ea7-913d-13fef6bca657 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 1cb3ce1b-f994-4a4b-9f06-12a001fcd081] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:14:26.207530 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:14:26.212288 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-bc01b0ce-ca5c-4ea7-913d-13fef6bca657 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:14:26.212733 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-bc01b0ce-ca5c-4ea7-913d-13fef6bca657 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:14:26.213538 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-bc01b0ce-ca5c-4ea7-913d-13fef6bca657 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:14:26.214352 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-bc01b0ce-ca5c-4ea7-913d-13fef6bca657 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:14:26.219042 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:14:26.351280 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-bc01b0ce-ca5c-4ea7-913d-13fef6bca657 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:14:26.359761 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-bc01b0ce-ca5c-4ea7-913d-13fef6bca657 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/1cb3ce1b-f994-4a4b-9f06-12a001fcd081" status: 200 len: 1266 microversion: 2.1 time: 0.159930 May 31 21:14:26.360772 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 492/1006] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:14:26 2022] GET /compute/v2.1/servers/1cb3ce1b-f994-4a4b-9f06-12a001fcd081 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:14:27.377217 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-21aafe76-2892-430c-a33e-6b1172022105 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:14:27.377840 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-21aafe76-2892-430c-a33e-6b1172022105 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 1cb3ce1b-f994-4a4b-9f06-12a001fcd081] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:14:27.386073 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-21aafe76-2892-430c-a33e-6b1172022105 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:14:27.386525 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-21aafe76-2892-430c-a33e-6b1172022105 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:14:27.387302 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-21aafe76-2892-430c-a33e-6b1172022105 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:14:27.387953 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-21aafe76-2892-430c-a33e-6b1172022105 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:14:27.519810 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-21aafe76-2892-430c-a33e-6b1172022105 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:14:27.527459 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-21aafe76-2892-430c-a33e-6b1172022105 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/1cb3ce1b-f994-4a4b-9f06-12a001fcd081" status: 200 len: 1266 microversion: 2.1 time: 0.154760 May 31 21:14:27.528027 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 515/1007] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:14:27 2022] GET /compute/v2.1/servers/1cb3ce1b-f994-4a4b-9f06-12a001fcd081 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:14:28.543771 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-9feefd43-239b-4e8f-92e7-dea28c149359 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:14:28.544380 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-9feefd43-239b-4e8f-92e7-dea28c149359 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 1cb3ce1b-f994-4a4b-9f06-12a001fcd081] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:14:28.552608 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9feefd43-239b-4e8f-92e7-dea28c149359 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:14:28.553062 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9feefd43-239b-4e8f-92e7-dea28c149359 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:14:28.553837 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9feefd43-239b-4e8f-92e7-dea28c149359 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:14:28.554304 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9feefd43-239b-4e8f-92e7-dea28c149359 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:14:28.699654 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-9feefd43-239b-4e8f-92e7-dea28c149359 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:14:28.708593 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-9feefd43-239b-4e8f-92e7-dea28c149359 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/1cb3ce1b-f994-4a4b-9f06-12a001fcd081" status: 200 len: 1266 microversion: 2.1 time: 0.168853 May 31 21:14:28.714176 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 493/1008] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:14:28 2022] GET /compute/v2.1/servers/1cb3ce1b-f994-4a4b-9f06-12a001fcd081 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:14:29.728713 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-a4770a45-edc1-4f78-90c0-5a3a49802977 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:14:29.729319 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-a4770a45-edc1-4f78-90c0-5a3a49802977 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 1cb3ce1b-f994-4a4b-9f06-12a001fcd081] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:14:29.735843 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a4770a45-edc1-4f78-90c0-5a3a49802977 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:14:29.736287 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a4770a45-edc1-4f78-90c0-5a3a49802977 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:14:29.737048 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a4770a45-edc1-4f78-90c0-5a3a49802977 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:14:29.737477 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a4770a45-edc1-4f78-90c0-5a3a49802977 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:14:29.873727 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-a4770a45-edc1-4f78-90c0-5a3a49802977 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:14:29.881774 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-a4770a45-edc1-4f78-90c0-5a3a49802977 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/1cb3ce1b-f994-4a4b-9f06-12a001fcd081" status: 200 len: 1266 microversion: 2.1 time: 0.156921 May 31 21:14:29.882365 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 516/1009] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:14:29 2022] GET /compute/v2.1/servers/1cb3ce1b-f994-4a4b-9f06-12a001fcd081 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:14:30.898927 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-23e5d644-fa2c-4efe-acb8-08ec70eee439 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:14:30.899664 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-23e5d644-fa2c-4efe-acb8-08ec70eee439 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 1cb3ce1b-f994-4a4b-9f06-12a001fcd081] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:14:30.906311 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-23e5d644-fa2c-4efe-acb8-08ec70eee439 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:14:30.906803 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-23e5d644-fa2c-4efe-acb8-08ec70eee439 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:14:30.907578 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-23e5d644-fa2c-4efe-acb8-08ec70eee439 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:14:30.908021 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-23e5d644-fa2c-4efe-acb8-08ec70eee439 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:14:31.049380 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-23e5d644-fa2c-4efe-acb8-08ec70eee439 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:14:31.057802 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-23e5d644-fa2c-4efe-acb8-08ec70eee439 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/1cb3ce1b-f994-4a4b-9f06-12a001fcd081" status: 200 len: 1453 microversion: 2.1 time: 0.163113 May 31 21:14:31.058625 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 494/1010] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:14:30 2022] GET /compute/v2.1/servers/1cb3ce1b-f994-4a4b-9f06-12a001fcd081 => generated 1453 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:14:31.074763 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-7d8e2246-43f4-4d24-9135-c724dfce2743 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:14:31.075721 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-7d8e2246-43f4-4d24-9135-c724dfce2743 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 1cb3ce1b-f994-4a4b-9f06-12a001fcd081] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:14:31.083389 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7d8e2246-43f4-4d24-9135-c724dfce2743 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:14:31.083841 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7d8e2246-43f4-4d24-9135-c724dfce2743 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:14:31.084619 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7d8e2246-43f4-4d24-9135-c724dfce2743 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:14:31.085068 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7d8e2246-43f4-4d24-9135-c724dfce2743 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:14:31.221396 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-7d8e2246-43f4-4d24-9135-c724dfce2743 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:14:31.229675 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-7d8e2246-43f4-4d24-9135-c724dfce2743 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/1cb3ce1b-f994-4a4b-9f06-12a001fcd081" status: 200 len: 1453 microversion: 2.1 time: 0.159603 May 31 21:14:31.230270 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 517/1011] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:14:31 2022] GET /compute/v2.1/servers/1cb3ce1b-f994-4a4b-9f06-12a001fcd081 => generated 1453 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:14:33.463357 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [req-b119cdd6-b1db-4c0e-a387-3ba2c13fdbeb req-46f85222-ef97-4a19-8541-02596e342cba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cb3ce1b-f994-4a4b-9f06-12a001fcd081", "tag": "b6ddeae7-2540-4694-af04-5e45ce14eb5e"}]} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:14:33.473933 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-b119cdd6-b1db-4c0e-a387-3ba2c13fdbeb req-46f85222-ef97-4a19-8541-02596e342cba service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:14:33.475803 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-b119cdd6-b1db-4c0e-a387-3ba2c13fdbeb req-46f85222-ef97-4a19-8541-02596e342cba service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:14:33.490760 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.compute.server_external_events [req-b119cdd6-b1db-4c0e-a387-3ba2c13fdbeb req-46f85222-ef97-4a19-8541-02596e342cba service nova] Creating event network-changed:b6ddeae7-2540-4694-af04-5e45ce14eb5e for instance 1cb3ce1b-f994-4a4b-9f06-12a001fcd081 on hv-cinder-83979 May 31 21:14:33.496732 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [req-b119cdd6-b1db-4c0e-a387-3ba2c13fdbeb req-46f85222-ef97-4a19-8541-02596e342cba service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037140 May 31 21:14:33.500211 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 495/1012] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:14:46.313221 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_api:SELECT=7 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:14:46.314695 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell1:SELECT=23 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:14:46.519963 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-be2ca920-9b80-4d90-a64b-36430d9f24a6 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Action: 'create', calling method: .version_select at 0x7fe7c0abf940>, body: {"keypair": {"name": "tempest-TestShelveInstance-1124702584", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWoMwsASoxukdpWXYKVFh/LU1p7wGd6IT+WmLEuBx8uSZiWzxRRTLOgzCL9ftxpslcInpmppSWv1oWrGR6HvfDbi24dIPYKirRCq44T30r+WrnpJpAb7XCyGEZGrsG3GQ=="}} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:14:46.534288 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.quota [None req-be2ca920-9b80-4d90-a64b-36430d9f24a6 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Getting quotas for project d9c46b1e7a32484b9c22387f2aaeb871. Resources: {'key_pairs'} {{(pid=118184) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 21:14:46.539034 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.quota [None req-be2ca920-9b80-4d90-a64b-36430d9f24a6 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Getting quotas for user 782845f8e6a440b684ae46a6ed118a62 and project d9c46b1e7a32484b9c22387f2aaeb871. Resources: {'key_pairs'} {{(pid=118184) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 21:14:46.650353 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-be2ca920-9b80-4d90-a64b-36430d9f24a6 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.342011 May 31 21:14:46.658254 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 518/1013] 10.222.0.55 () {60 vars in 1158 bytes} [Tue May 31 21:14:46 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:15:16.380660 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_api:SELECT=7 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:15:16.382165 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell1:SELECT=19 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:15:16.386038 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-90f2f4ab-691e-4b04-9e55-affc60ed66e6 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1702338288", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1124702584", "security_groups": [{"name": "tempest-secgroup-smoke-1441867213"}], "networks": [{"uuid": "b57e19b6-0914-4711-9006-4e82330c3537"}], "block_device_mapping_v2": [{"uuid": "4667bff7-6ebc-4c66-9bdc-7c5b9a84ce89", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:15:16.504162 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.network.neutron [None req-90f2f4ab-691e-4b04-9e55-affc60ed66e6 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] validate_networks() for [('b57e19b6-0914-4711-9006-4e82330c3537', None, None, None, None, None)] {{(pid=118185) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 21:15:17.012328 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.virt.hardware [None req-90f2f4ab-691e-4b04-9e55-affc60ed66e6 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Flavor limits 0:0:0 {{(pid=118185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 21:15:17.012750 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.virt.hardware [None req-90f2f4ab-691e-4b04-9e55-affc60ed66e6 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Image limits 0:0:0 {{(pid=118185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 21:15:17.013220 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.virt.hardware [None req-90f2f4ab-691e-4b04-9e55-affc60ed66e6 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Flavor pref 0:0:0 {{(pid=118185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 21:15:17.013624 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.virt.hardware [None req-90f2f4ab-691e-4b04-9e55-affc60ed66e6 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Image pref 0:0:0 {{(pid=118185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 21:15:17.014070 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.virt.hardware [None req-90f2f4ab-691e-4b04-9e55-affc60ed66e6 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 21:15:17.023146 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-90f2f4ab-691e-4b04-9e55-affc60ed66e6 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:17.023593 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-90f2f4ab-691e-4b04-9e55-affc60ed66e6 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:17.024393 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-90f2f4ab-691e-4b04-9e55-affc60ed66e6 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:17.024830 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-90f2f4ab-691e-4b04-9e55-affc60ed66e6 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:17.041746 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.quota [None req-90f2f4ab-691e-4b04-9e55-affc60ed66e6 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Getting quotas for project d9c46b1e7a32484b9c22387f2aaeb871. Resources: {'ram', 'cores', 'instances'} {{(pid=118185) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 21:15:17.045947 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.quota [None req-90f2f4ab-691e-4b04-9e55-affc60ed66e6 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Getting quotas for user 782845f8e6a440b684ae46a6ed118a62 and project d9c46b1e7a32484b9c22387f2aaeb871. Resources: {'ram', 'cores', 'instances'} {{(pid=118185) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 21:15:17.108366 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-90f2f4ab-691e-4b04-9e55-affc60ed66e6 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Going to run 1 instances... {{(pid=118185) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 21:15:17.108366 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-90f2f4ab-691e-4b04-9e55-affc60ed66e6 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] [instance: 45453898-e1e4-44bb-8af5-3a1729aa2870] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4667bff7-6ebc-4c66-9bdc-7c5b9a84ce89',volume_size=None,volume_type=None)] {{(pid=118185) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 21:15:17.683179 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-90f2f4ab-691e-4b04-9e55-affc60ed66e6 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.304537 May 31 21:15:17.683872 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 496/1014] 10.222.0.55 () {60 vars in 1146 bytes} [Tue May 31 21:15:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 1306 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 31 21:15:17.694154 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-3e802a6c-f787-4b46-ade3-2dcd375b45b3 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:17.701312 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-3e802a6c-f787-4b46-ade3-2dcd375b45b3 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] [instance: 45453898-e1e4-44bb-8af5-3a1729aa2870] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:17.706599 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell0:SELECT=4 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:15:17.707882 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:15:17.770479 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-3e802a6c-f787-4b46-ade3-2dcd375b45b3 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782845f8e6a440b684ae46a6ed118a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c46b1e7a32484b9c22387f2aaeb871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:17.779540 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-3e802a6c-f787-4b46-ade3-2dcd375b45b3 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] 10.222.0.55 "GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870" status: 200 len: 1089 microversion: 2.1 time: 0.089485 May 31 21:15:17.785966 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 519/1015] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:17 2022] GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870 => generated 1089 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:15:17.825463 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-0760bda9-bf0c-4441-9f8a-94d9445ec078 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:17.826072 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-0760bda9-bf0c-4441-9f8a-94d9445ec078 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:17.847051 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-0760bda9-bf0c-4441-9f8a-94d9445ec078 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:17.847516 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-0760bda9-bf0c-4441-9f8a-94d9445ec078 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:17.848526 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-0760bda9-bf0c-4441-9f8a-94d9445ec078 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:17.849790 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-0760bda9-bf0c-4441-9f8a-94d9445ec078 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:17.876702 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-0760bda9-bf0c-4441-9f8a-94d9445ec078 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982/ips" status: 200 len: 149 microversion: 2.1 time: 0.055613 May 31 21:15:17.877417 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 497/1016] 10.222.0.55 () {58 vars in 1247 bytes} [Tue May 31 21:15:17 2022] GET /compute/v2.1/servers/5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982/ips => generated 149 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:15:17.897343 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-6ea7129a-5523-4761-b6ec-0703d3606435 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "06c97b8d-40ba-4efc-baba-bc7096f3aa63"}} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:15:17.898623 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-6ea7129a-5523-4761-b6ec-0703d3606435 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:17.905032 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6ea7129a-5523-4761-b6ec-0703d3606435 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:17.905487 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6ea7129a-5523-4761-b6ec-0703d3606435 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:17.906289 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6ea7129a-5523-4761-b6ec-0703d3606435 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:17.906811 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6ea7129a-5523-4761-b6ec-0703d3606435 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:17.991337 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.wsgi [None req-6ea7129a-5523-4761-b6ec-0703d3606435 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] HTTP exception thrown: Invalid volume: volume 06c97b8d-40ba-4efc-baba-bc7096f3aa63 is already attached to instances: 5cb669a7-8e63-46ac-86f6-1be4050a44ec May 31 21:15:17.993074 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-6ea7129a-5523-4761-b6ec-0703d3606435 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Request method failure captured: May 31 21:15:17.993074 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: request: POST /compute/v2.1/servers/5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982/os-volume_attachments HTTP/1.1 May 31 21:15:17.993074 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Accept: application/json May 31 21:15:17.993074 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Accept-Encoding: identity May 31 21:15:17.993074 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Connection: close May 31 21:15:17.993074 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Content-Length: 74 May 31 21:15:17.993074 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Content-Type: application/json May 31 21:15:17.993074 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Host: 10.222.0.55 May 31 21:15:17.993074 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Openstack-System-Scope: None May 31 21:15:17.993074 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: User-Agent: python-urllib3/1.26.9 May 31 21:15:17.993074 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Auth-Token: gAAAAABiloR6qg65df265xnXkf0TY6yHSXRv8NS86FmUnFNzjk_pCIOLgrgfJbkxmZYFC66OdFLRA4PHOQ2UiyK6Br4eaixrZ-5NlYmO2AXCMbb_Qo66xtWpyddhdAMGxddxV67OHhRmLW9fy2wijnAPzU9Ur_Oi62eu23Z9lUdWg-uvkw7ldZA May 31 21:15:17.993074 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Domain-Id: None May 31 21:15:17.993074 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Domain-Name: None May 31 21:15:17.993074 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Identity-Status: Confirmed May 31 21:15:17.993074 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Is-Admin-Project: True May 31 21:15:17.993074 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Domain-Id: default May 31 21:15:17.993074 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Domain-Name: Default May 31 21:15:17.993074 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Id: 69b2364f40d14160adf0220d92adaad7 May 31 21:15:17.993074 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Name: tempest-AttachVolumeNegativeTest-14232740 May 31 21:15:17.993074 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Role: member,reader May 31 21:15:17.993074 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Roles: member,reader May 31 21:15:17.994638 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/69b2364f40d14160adf0220d92adaad7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/69b2364f40d14160adf0220d92adaad7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_69b2364f40d14160adf0220d92adaad7", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/69b2364f40d14160adf0220d92adaad7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] May 31 21:15:17.994638 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant: tempest-AttachVolumeNegativeTest-14232740 May 31 21:15:17.994638 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant-Id: 69b2364f40d14160adf0220d92adaad7 May 31 21:15:17.994638 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-14232740 May 31 21:15:17.994638 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User: tempest-AttachVolumeNegativeTest-14232740-project May 31 21:15:17.994638 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Domain-Id: default May 31 21:15:17.994638 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Domain-Name: Default May 31 21:15:17.994638 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Id: 8efe37a6d57b4775b4e47a295c3f5eee May 31 21:15:17.994638 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Name: tempest-AttachVolumeNegativeTest-14232740-project May 31 21:15:17.994638 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: May 31 21:15:17.994638 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: {"volumeAttachment": {"volumeId": "06c97b8d-40ba-4efc-baba-bc7096f3aa63"}} May 31 21:15:17.994638 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: method: > May 31 21:15:17.995558 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: exception: Invalid volume: volume 06c97b8d-40ba-4efc-baba-bc7096f3aa63 is already attached to instances: 5cb669a7-8e63-46ac-86f6-1be4050a44ec May 31 21:15:17.995558 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: action_args: {'server_id': '5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982', 'body': {'volumeAttachment': {'volumeId': '06c97b8d-40ba-4efc-baba-bc7096f3aa63'}}} May 31 21:15:17.995558 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 21:15:17.995558 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:15:17.995558 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 31 21:15:17.995558 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 31 21:15:17.995558 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 31 21:15:17.995558 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 31 21:15:17.995558 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 31 21:15:17.995558 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 31 21:15:17.995558 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 31 21:15:17.995558 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 31 21:15:17.995558 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 31 21:15:17.995558 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 31 21:15:17.995558 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 06c97b8d-40ba-4efc-baba-bc7096f3aa63 is already attached to instances: 5cb669a7-8e63-46ac-86f6-1be4050a44ec May 31 21:15:17.995558 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:15:17.995558 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:15:17.995558 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:15:17.995558 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:15:17.996893 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:15:17.996893 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:15:17.996893 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 21:15:17.996893 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 21:15:17.996893 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 21:15:17.996893 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 21:15:17.996893 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 31 21:15:17.996893 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 31 21:15:17.996893 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 31 21:15:17.996893 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 31 21:15:17.996893 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 31 21:15:17.996893 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 31 21:15:17.996893 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 31 21:15:17.996893 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 31 21:15:17.996893 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 06c97b8d-40ba-4efc-baba-bc7096f3aa63 is already attached to instances: 5cb669a7-8e63-46ac-86f6-1be4050a44ec May 31 21:15:17.996893 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:15:17.996893 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:15:17.996893 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:15:17.996893 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:15:17.996893 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:15:17.998292 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:15:17.998292 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 21:15:17.998292 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 21:15:17.998292 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 06c97b8d-40ba-4efc-baba-bc7096f3aa63 is already attached to instances: 5cb669a7-8e63-46ac-86f6-1be4050a44ec May 31 21:15:17.998292 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:15:17.998292 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-6ea7129a-5523-4761-b6ec-0703d3606435 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Returning 400 to user: Invalid volume: volume 06c97b8d-40ba-4efc-baba-bc7096f3aa63 is already attached to instances: 5cb669a7-8e63-46ac-86f6-1be4050a44ec {{(pid=118184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 21:15:17.998292 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-6ea7129a-5523-4761-b6ec-0703d3606435 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "POST /compute/v2.1/servers/5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.110492 May 31 21:15:17.998292 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 520/1017] 10.222.0.55 () {60 vars in 1322 bytes} [Tue May 31 21:15:17 2022] POST /compute/v2.1/servers/5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982/os-volume_attachments => generated 174 bytes in 112 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 31 21:15:18.004397 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-689fde32-02c5-491a-b2eb-b1fcdcdc24e7 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:18.004896 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-689fde32-02c5-491a-b2eb-b1fcdcdc24e7 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:18.011484 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-689fde32-02c5-491a-b2eb-b1fcdcdc24e7 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:18.011934 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-689fde32-02c5-491a-b2eb-b1fcdcdc24e7 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:18.012701 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-689fde32-02c5-491a-b2eb-b1fcdcdc24e7 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:18.013141 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-689fde32-02c5-491a-b2eb-b1fcdcdc24e7 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:18.037990 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-689fde32-02c5-491a-b2eb-b1fcdcdc24e7 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982] Going to try to terminate instance {{(pid=118185) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 21:15:18.406923 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-689fde32-02c5-491a-b2eb-b1fcdcdc24e7 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "DELETE /compute/v2.1/servers/5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982" status: 204 len: 0 microversion: 2.1 time: 0.406886 May 31 21:15:18.407580 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 498/1018] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 31 21:15:17 2022] DELETE /compute/v2.1/servers/5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 31 21:15:18.415844 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-4f5172f9-7969-428a-b383-a2400b89fd2b tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:18.419701 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-4f5172f9-7969-428a-b383-a2400b89fd2b tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:18.423979 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4f5172f9-7969-428a-b383-a2400b89fd2b tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:18.424439 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4f5172f9-7969-428a-b383-a2400b89fd2b tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:18.425256 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4f5172f9-7969-428a-b383-a2400b89fd2b tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:18.425697 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4f5172f9-7969-428a-b383-a2400b89fd2b tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:18.562709 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-4f5172f9-7969-428a-b383-a2400b89fd2b tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe37a6d57b4775b4e47a295c3f5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b2364f40d14160adf0220d92adaad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:18.568752 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-4f5172f9-7969-428a-b383-a2400b89fd2b tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982" status: 200 len: 1680 microversion: 2.1 time: 0.156985 May 31 21:15:18.569315 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 521/1019] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:18 2022] GET /compute/v2.1/servers/5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:15:18.797577 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-c8dce24e-cd73-49c6-bbe5-a665c34bcf3c tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:18.798570 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-c8dce24e-cd73-49c6-bbe5-a665c34bcf3c tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] [instance: 45453898-e1e4-44bb-8af5-3a1729aa2870] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:18.855274 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-c8dce24e-cd73-49c6-bbe5-a665c34bcf3c tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782845f8e6a440b684ae46a6ed118a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c46b1e7a32484b9c22387f2aaeb871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:18.863767 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-c8dce24e-cd73-49c6-bbe5-a665c34bcf3c tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] 10.222.0.55 "GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870" status: 200 len: 1089 microversion: 2.1 time: 0.070723 May 31 21:15:18.864347 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 499/1020] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:18 2022] GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870 => generated 1089 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:15:18.919296 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-ee282de2-6e48-4dcb-a013-fb165d360233 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1200749744", "imageRef": "21b89996-9e87-489d-8891-305f6c3d905a", "flavorRef": "452", "networks": [{"uuid": "710ad2ad-e004-4b3f-9e04-41d28feb1281"}]}} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:15:18.970506 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.network.neutron [None req-ee282de2-6e48-4dcb-a013-fb165d360233 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] validate_networks() for [('710ad2ad-e004-4b3f-9e04-41d28feb1281', None, None, None, None, None)] {{(pid=118184) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 21:15:19.309152 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.virt.hardware [None req-ee282de2-6e48-4dcb-a013-fb165d360233 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Flavor limits 0:0:0 {{(pid=118184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 21:15:19.309577 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.virt.hardware [None req-ee282de2-6e48-4dcb-a013-fb165d360233 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Image limits 0:0:0 {{(pid=118184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 21:15:19.310108 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.virt.hardware [None req-ee282de2-6e48-4dcb-a013-fb165d360233 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Flavor pref 0:0:0 {{(pid=118184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 21:15:19.310521 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.virt.hardware [None req-ee282de2-6e48-4dcb-a013-fb165d360233 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Image pref 0:0:0 {{(pid=118184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 21:15:19.310934 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.virt.hardware [None req-ee282de2-6e48-4dcb-a013-fb165d360233 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 21:15:19.319721 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ee282de2-6e48-4dcb-a013-fb165d360233 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:19.320172 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ee282de2-6e48-4dcb-a013-fb165d360233 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:19.320968 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ee282de2-6e48-4dcb-a013-fb165d360233 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:19.321410 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ee282de2-6e48-4dcb-a013-fb165d360233 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:19.338520 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.quota [None req-ee282de2-6e48-4dcb-a013-fb165d360233 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Getting quotas for project 329e95cbfdb9493d82941bc00dd1ccbe. Resources: {'ram', 'cores', 'instances'} {{(pid=118184) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 21:15:19.342303 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.quota [None req-ee282de2-6e48-4dcb-a013-fb165d360233 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Getting quotas for user 19f6c089e7ec4ca5914d760e742d89b3 and project 329e95cbfdb9493d82941bc00dd1ccbe. Resources: {'ram', 'cores', 'instances'} {{(pid=118184) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 21:15:19.353785 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-ee282de2-6e48-4dcb-a013-fb165d360233 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Going to run 1 instances... {{(pid=118184) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 21:15:19.356088 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-ee282de2-6e48-4dcb-a013-fb165d360233 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] [instance: 836874db-02ab-4f3d-8b87-d32c70829b1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='21b89996-9e87-489d-8891-305f6c3d905a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118184) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 21:15:19.492203 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-ee282de2-6e48-4dcb-a013-fb165d360233 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.576707 May 31 21:15:19.492856 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 522/1021] 10.222.0.55 () {60 vars in 1146 bytes} [Tue May 31 21:15:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 31 21:15:19.502718 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-648b62a3-be2e-43cf-83ee-88d1ba219eaf tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:19.503330 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-648b62a3-be2e-43cf-83ee-88d1ba219eaf tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] [instance: 836874db-02ab-4f3d-8b87-d32c70829b1b] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:19.555429 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-648b62a3-be2e-43cf-83ee-88d1ba219eaf tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19f6c089e7ec4ca5914d760e742d89b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329e95cbfdb9493d82941bc00dd1ccbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:19.563087 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-648b62a3-be2e-43cf-83ee-88d1ba219eaf tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] 10.222.0.55 "GET /compute/v2.1/servers/836874db-02ab-4f3d-8b87-d32c70829b1b" status: 200 len: 1219 microversion: 2.1 time: 0.064127 May 31 21:15:19.568273 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 500/1022] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:19 2022] GET /compute/v2.1/servers/836874db-02ab-4f3d-8b87-d32c70829b1b => generated 1219 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:15:19.588370 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-73a69d43-bf10-477c-9888-08c1dc6461f8 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:19.589430 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-73a69d43-bf10-477c-9888-08c1dc6461f8 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:19.597235 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-73a69d43-bf10-477c-9888-08c1dc6461f8 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:19.597941 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-73a69d43-bf10-477c-9888-08c1dc6461f8 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:19.599184 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-73a69d43-bf10-477c-9888-08c1dc6461f8 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:19.599745 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-73a69d43-bf10-477c-9888-08c1dc6461f8 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:19.735253 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-73a69d43-bf10-477c-9888-08c1dc6461f8 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe37a6d57b4775b4e47a295c3f5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b2364f40d14160adf0220d92adaad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:19.742823 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-73a69d43-bf10-477c-9888-08c1dc6461f8 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982" status: 200 len: 1680 microversion: 2.1 time: 0.159824 May 31 21:15:19.743382 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 523/1023] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:19 2022] GET /compute/v2.1/servers/5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:15:19.881244 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-ed78bb43-9ed3-4a89-afb8-fc674b7455a7 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:19.881846 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-ed78bb43-9ed3-4a89-afb8-fc674b7455a7 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] [instance: 45453898-e1e4-44bb-8af5-3a1729aa2870] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:19.888812 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ed78bb43-9ed3-4a89-afb8-fc674b7455a7 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:19.889290 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ed78bb43-9ed3-4a89-afb8-fc674b7455a7 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:19.890074 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ed78bb43-9ed3-4a89-afb8-fc674b7455a7 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:19.890510 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ed78bb43-9ed3-4a89-afb8-fc674b7455a7 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:19.951313 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-ed78bb43-9ed3-4a89-afb8-fc674b7455a7 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782845f8e6a440b684ae46a6ed118a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c46b1e7a32484b9c22387f2aaeb871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:19.959133 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-ed78bb43-9ed3-4a89-afb8-fc674b7455a7 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] 10.222.0.55 "GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870" status: 200 len: 1131 microversion: 2.1 time: 0.082543 May 31 21:15:19.959702 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 501/1024] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:19 2022] GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870 => generated 1131 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:15:20.581862 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-238c4ed9-a092-4936-919f-5af8f5bc65d3 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:20.583958 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-238c4ed9-a092-4936-919f-5af8f5bc65d3 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] [instance: 836874db-02ab-4f3d-8b87-d32c70829b1b] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:20.591125 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-238c4ed9-a092-4936-919f-5af8f5bc65d3 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:20.591815 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-238c4ed9-a092-4936-919f-5af8f5bc65d3 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:20.592775 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-238c4ed9-a092-4936-919f-5af8f5bc65d3 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:20.593392 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-238c4ed9-a092-4936-919f-5af8f5bc65d3 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:20.656161 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-238c4ed9-a092-4936-919f-5af8f5bc65d3 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19f6c089e7ec4ca5914d760e742d89b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329e95cbfdb9493d82941bc00dd1ccbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:20.664533 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-238c4ed9-a092-4936-919f-5af8f5bc65d3 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] 10.222.0.55 "GET /compute/v2.1/servers/836874db-02ab-4f3d-8b87-d32c70829b1b" status: 200 len: 1223 microversion: 2.1 time: 0.087666 May 31 21:15:20.670829 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 524/1025] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:20 2022] GET /compute/v2.1/servers/836874db-02ab-4f3d-8b87-d32c70829b1b => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:15:20.760663 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-f2e567d1-39a1-41ac-96b5-893eb95a2c15 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:20.762119 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-f2e567d1-39a1-41ac-96b5-893eb95a2c15 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:20.768199 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f2e567d1-39a1-41ac-96b5-893eb95a2c15 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:20.768653 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f2e567d1-39a1-41ac-96b5-893eb95a2c15 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:20.769438 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f2e567d1-39a1-41ac-96b5-893eb95a2c15 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:20.769874 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f2e567d1-39a1-41ac-96b5-893eb95a2c15 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:20.844590 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-f2e567d1-39a1-41ac-96b5-893eb95a2c15 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe37a6d57b4775b4e47a295c3f5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b2364f40d14160adf0220d92adaad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:20.864009 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-f2e567d1-39a1-41ac-96b5-893eb95a2c15 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982" status: 200 len: 1612 microversion: 2.1 time: 0.107147 May 31 21:15:20.865685 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 502/1026] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:20 2022] GET /compute/v2.1/servers/5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982 => generated 1612 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:15:20.979564 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-b35f036a-9333-4244-bbe8-7dc2e59ea606 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:20.980320 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-b35f036a-9333-4244-bbe8-7dc2e59ea606 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] [instance: 45453898-e1e4-44bb-8af5-3a1729aa2870] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:20.987732 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b35f036a-9333-4244-bbe8-7dc2e59ea606 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:20.988606 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b35f036a-9333-4244-bbe8-7dc2e59ea606 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:20.990145 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b35f036a-9333-4244-bbe8-7dc2e59ea606 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:20.990694 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b35f036a-9333-4244-bbe8-7dc2e59ea606 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:21.061432 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-b35f036a-9333-4244-bbe8-7dc2e59ea606 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782845f8e6a440b684ae46a6ed118a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c46b1e7a32484b9c22387f2aaeb871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:21.071240 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-b35f036a-9333-4244-bbe8-7dc2e59ea606 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] 10.222.0.55 "GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870" status: 200 len: 1205 microversion: 2.1 time: 0.098598 May 31 21:15:21.072435 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 525/1027] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:20 2022] GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870 => generated 1205 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:15:21.488097 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [req-1fa691dc-a41f-4f87-a9db-930e68069cfe req-3317ff94-5600-4318-af9d-e14378bcd49f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982", "name": "network-vif-deleted", "tag": "d2db5c87-efce-4692-aa2a-48540d4ccc40"}]} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:15:21.491586 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-1fa691dc-a41f-4f87-a9db-930e68069cfe req-3317ff94-5600-4318-af9d-e14378bcd49f service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:21.492430 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-1fa691dc-a41f-4f87-a9db-930e68069cfe req-3317ff94-5600-4318-af9d-e14378bcd49f service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:21.504638 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.compute.server_external_events [req-1fa691dc-a41f-4f87-a9db-930e68069cfe req-3317ff94-5600-4318-af9d-e14378bcd49f service nova] Creating event network-vif-deleted:d2db5c87-efce-4692-aa2a-48540d4ccc40 for instance 5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982 on hv-cinder-83979 May 31 21:15:21.510288 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [req-1fa691dc-a41f-4f87-a9db-930e68069cfe req-3317ff94-5600-4318-af9d-e14378bcd49f service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.252923 May 31 21:15:21.515389 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 503/1028] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:15:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:15:21.681667 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-b97cb2ac-85e2-479c-b203-9d15a3c6c52e tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:21.683000 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-b97cb2ac-85e2-479c-b203-9d15a3c6c52e tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] [instance: 836874db-02ab-4f3d-8b87-d32c70829b1b] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:21.690033 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b97cb2ac-85e2-479c-b203-9d15a3c6c52e tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:21.690518 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b97cb2ac-85e2-479c-b203-9d15a3c6c52e tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:21.691324 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b97cb2ac-85e2-479c-b203-9d15a3c6c52e tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:21.691775 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b97cb2ac-85e2-479c-b203-9d15a3c6c52e tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:21.776102 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-b97cb2ac-85e2-479c-b203-9d15a3c6c52e tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19f6c089e7ec4ca5914d760e742d89b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329e95cbfdb9493d82941bc00dd1ccbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:21.789936 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-b97cb2ac-85e2-479c-b203-9d15a3c6c52e tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] 10.222.0.55 "GET /compute/v2.1/servers/836874db-02ab-4f3d-8b87-d32c70829b1b" status: 200 len: 1279 microversion: 2.1 time: 0.112468 May 31 21:15:21.791295 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 526/1029] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:21 2022] GET /compute/v2.1/servers/836874db-02ab-4f3d-8b87-d32c70829b1b => generated 1279 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:15:21.884180 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-75c4d3df-c95e-47d0-b964-a7f54f769071 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:21.885203 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-75c4d3df-c95e-47d0-b964-a7f54f769071 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:21.897083 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-75c4d3df-c95e-47d0-b964-a7f54f769071 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:21.898679 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-75c4d3df-c95e-47d0-b964-a7f54f769071 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:21.899838 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-75c4d3df-c95e-47d0-b964-a7f54f769071 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:21.904041 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-75c4d3df-c95e-47d0-b964-a7f54f769071 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:21.956301 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-75c4d3df-c95e-47d0-b964-a7f54f769071 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:21.957025 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-75c4d3df-c95e-47d0-b964-a7f54f769071 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:21.957484 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.objects.instance [None req-75c4d3df-c95e-47d0-b964-a7f54f769071 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lazy-loading 'fault' on Instance uuid 5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982 {{(pid=118185) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 21:15:22.000702 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-75c4d3df-c95e-47d0-b964-a7f54f769071 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe37a6d57b4775b4e47a295c3f5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b2364f40d14160adf0220d92adaad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:22.010002 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-75c4d3df-c95e-47d0-b964-a7f54f769071 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982" status: 200 len: 1330 microversion: 2.1 time: 0.131714 May 31 21:15:22.010747 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 504/1030] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:21 2022] GET /compute/v2.1/servers/5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982 => generated 1330 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:15:22.089596 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-de957965-9005-407f-a881-f77a249306c9 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:22.090317 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-de957965-9005-407f-a881-f77a249306c9 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] [instance: 45453898-e1e4-44bb-8af5-3a1729aa2870] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:22.100763 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-de957965-9005-407f-a881-f77a249306c9 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:22.100763 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-de957965-9005-407f-a881-f77a249306c9 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:22.100763 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-de957965-9005-407f-a881-f77a249306c9 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:22.100763 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-de957965-9005-407f-a881-f77a249306c9 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:22.317218 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-de957965-9005-407f-a881-f77a249306c9 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782845f8e6a440b684ae46a6ed118a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c46b1e7a32484b9c22387f2aaeb871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:22.326883 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-de957965-9005-407f-a881-f77a249306c9 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] 10.222.0.55 "GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870" status: 200 len: 1273 microversion: 2.1 time: 0.240539 May 31 21:15:22.327495 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 527/1031] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:22 2022] GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870 => generated 1273 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:15:22.811111 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-458f51fb-4d36-45f0-8214-20a9c28c7218 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:22.811852 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-458f51fb-4d36-45f0-8214-20a9c28c7218 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] [instance: 836874db-02ab-4f3d-8b87-d32c70829b1b] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:22.819537 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-458f51fb-4d36-45f0-8214-20a9c28c7218 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:22.820247 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-458f51fb-4d36-45f0-8214-20a9c28c7218 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:22.821145 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-458f51fb-4d36-45f0-8214-20a9c28c7218 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:22.821686 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-458f51fb-4d36-45f0-8214-20a9c28c7218 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:22.886103 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-458f51fb-4d36-45f0-8214-20a9c28c7218 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19f6c089e7ec4ca5914d760e742d89b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329e95cbfdb9493d82941bc00dd1ccbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:22.893679 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-458f51fb-4d36-45f0-8214-20a9c28c7218 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] 10.222.0.55 "GET /compute/v2.1/servers/836874db-02ab-4f3d-8b87-d32c70829b1b" status: 200 len: 1277 microversion: 2.1 time: 0.086887 May 31 21:15:22.894293 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 505/1032] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:22 2022] GET /compute/v2.1/servers/836874db-02ab-4f3d-8b87-d32c70829b1b => generated 1277 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:15:23.027663 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-a550b009-cc48-4c1c-8442-e52233604594 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:23.028278 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-a550b009-cc48-4c1c-8442-e52233604594 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:23.034975 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a550b009-cc48-4c1c-8442-e52233604594 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:23.035424 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a550b009-cc48-4c1c-8442-e52233604594 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:23.036226 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a550b009-cc48-4c1c-8442-e52233604594 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:23.036670 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a550b009-cc48-4c1c-8442-e52233604594 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:23.050653 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.wsgi [None req-a550b009-cc48-4c1c-8442-e52233604594 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] HTTP exception thrown: Instance 5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982 could not be found. May 31 21:15:23.052745 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-a550b009-cc48-4c1c-8442-e52233604594 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Request method failure captured: May 31 21:15:23.052745 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: request: GET /compute/v2.1/servers/5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982 HTTP/1.1 May 31 21:15:23.052745 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Accept: application/json May 31 21:15:23.052745 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Accept-Encoding: identity May 31 21:15:23.052745 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Connection: close May 31 21:15:23.052745 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Content-Length: 0 May 31 21:15:23.052745 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Content-Type: application/json May 31 21:15:23.052745 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Host: 10.222.0.55 May 31 21:15:23.052745 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Openstack-System-Scope: None May 31 21:15:23.052745 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: User-Agent: python-urllib3/1.26.9 May 31 21:15:23.052745 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Auth-Token: gAAAAABiloR6qg65df265xnXkf0TY6yHSXRv8NS86FmUnFNzjk_pCIOLgrgfJbkxmZYFC66OdFLRA4PHOQ2UiyK6Br4eaixrZ-5NlYmO2AXCMbb_Qo66xtWpyddhdAMGxddxV67OHhRmLW9fy2wijnAPzU9Ur_Oi62eu23Z9lUdWg-uvkw7ldZA May 31 21:15:23.052745 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Domain-Id: None May 31 21:15:23.052745 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Domain-Name: None May 31 21:15:23.052745 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Identity-Status: Confirmed May 31 21:15:23.052745 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Is-Admin-Project: True May 31 21:15:23.052745 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Domain-Id: default May 31 21:15:23.052745 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Domain-Name: Default May 31 21:15:23.052745 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Id: 69b2364f40d14160adf0220d92adaad7 May 31 21:15:23.052745 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Name: tempest-AttachVolumeNegativeTest-14232740 May 31 21:15:23.052745 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Role: member,reader May 31 21:15:23.052745 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Roles: member,reader May 31 21:15:23.054348 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/69b2364f40d14160adf0220d92adaad7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/69b2364f40d14160adf0220d92adaad7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_69b2364f40d14160adf0220d92adaad7", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/69b2364f40d14160adf0220d92adaad7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] May 31 21:15:23.054348 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant: tempest-AttachVolumeNegativeTest-14232740 May 31 21:15:23.054348 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant-Id: 69b2364f40d14160adf0220d92adaad7 May 31 21:15:23.054348 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-14232740 May 31 21:15:23.054348 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User: tempest-AttachVolumeNegativeTest-14232740-project May 31 21:15:23.054348 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Domain-Id: default May 31 21:15:23.054348 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Domain-Name: Default May 31 21:15:23.054348 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Id: 8efe37a6d57b4775b4e47a295c3f5eee May 31 21:15:23.054348 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Name: tempest-AttachVolumeNegativeTest-14232740-project May 31 21:15:23.054348 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: method: > May 31 21:15:23.054348 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: exception: Instance 5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982 could not be found. May 31 21:15:23.054348 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: action_args: {'id': '5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982'} May 31 21:15:23.055232 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 21:15:23.055232 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:15:23.055232 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 21:15:23.055232 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 21:15:23.055232 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 21:15:23.055232 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 21:15:23.055232 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 21:15:23.055232 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 21:15:23.055232 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 21:15:23.055232 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 21:15:23.055232 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982 could not be found. May 31 21:15:23.055232 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:15:23.055232 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:15:23.055232 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:15:23.055232 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:15:23.055232 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:15:23.055232 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:15:23.055232 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 21:15:23.055232 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 21:15:23.055232 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 21:15:23.056697 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 21:15:23.056697 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 21:15:23.056697 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 21:15:23.056697 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 21:15:23.056697 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 21:15:23.056697 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 21:15:23.056697 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 21:15:23.056697 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982 could not be found. May 31 21:15:23.056697 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:15:23.056697 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:15:23.056697 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:15:23.056697 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:15:23.056697 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:15:23.056697 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:15:23.056697 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 21:15:23.056697 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 21:15:23.056697 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982 could not be found. May 31 21:15:23.056697 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:15:23.058071 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-a550b009-cc48-4c1c-8442-e52233604594 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Returning 404 to user: Instance 5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982 could not be found. {{(pid=118184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 21:15:23.058071 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-a550b009-cc48-4c1c-8442-e52233604594 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982" status: 404 len: 111 microversion: 2.1 time: 0.030433 May 31 21:15:23.058071 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 528/1033] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:23 2022] GET /compute/v2.1/servers/5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 21:15:23.067039 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-1844710e-fdae-41db-bd63-766689cf4b22 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '.version_select at 0x7fe7c5f96c10>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:23.173498 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-1844710e-fdae-41db-bd63-766689cf4b22 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1447715153" status: 202 len: 0 microversion: 2.1 time: 0.110241 May 31 21:15:23.174698 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 506/1034] 10.222.0.55 () {58 vars in 1220 bytes} [Tue May 31 21:15:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1447715153 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 21:15:23.344576 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-ec6c2b5d-862a-4402-b848-4dddbd7a1a56 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:23.345189 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-ec6c2b5d-862a-4402-b848-4dddbd7a1a56 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] [instance: 45453898-e1e4-44bb-8af5-3a1729aa2870] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:23.353140 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ec6c2b5d-862a-4402-b848-4dddbd7a1a56 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:23.353791 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ec6c2b5d-862a-4402-b848-4dddbd7a1a56 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:23.354620 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ec6c2b5d-862a-4402-b848-4dddbd7a1a56 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:23.355051 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ec6c2b5d-862a-4402-b848-4dddbd7a1a56 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:23.613013 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-ec6c2b5d-862a-4402-b848-4dddbd7a1a56 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782845f8e6a440b684ae46a6ed118a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c46b1e7a32484b9c22387f2aaeb871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:23.623142 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-ec6c2b5d-862a-4402-b848-4dddbd7a1a56 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] 10.222.0.55 "GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870" status: 200 len: 1261 microversion: 2.1 time: 0.282232 May 31 21:15:23.623986 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 529/1035] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:23 2022] GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870 => generated 1261 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:15:23.767465 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [req-d786f1eb-08a7-45b5-a01d-02237b482227 req-1e916a23-5c19-4941-bfab-0756c978aece service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45453898-e1e4-44bb-8af5-3a1729aa2870", "tag": "6278ba73-77b2-4be4-a1a0-b7b239769dc3"}]} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:15:23.789052 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-d786f1eb-08a7-45b5-a01d-02237b482227 req-1e916a23-5c19-4941-bfab-0756c978aece service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:23.797243 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-d786f1eb-08a7-45b5-a01d-02237b482227 req-1e916a23-5c19-4941-bfab-0756c978aece service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:23.825188 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.compute.server_external_events [req-d786f1eb-08a7-45b5-a01d-02237b482227 req-1e916a23-5c19-4941-bfab-0756c978aece service nova] Creating event network-changed:6278ba73-77b2-4be4-a1a0-b7b239769dc3 for instance 45453898-e1e4-44bb-8af5-3a1729aa2870 on hv-cinder-83979 May 31 21:15:23.831553 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [req-d786f1eb-08a7-45b5-a01d-02237b482227 req-1e916a23-5c19-4941-bfab-0756c978aece service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068017 May 31 21:15:23.832927 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 507/1036] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:15:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:15:23.913197 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-10f4c9b7-85d3-4c8b-8e13-23cd394fd75c tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:23.913197 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-10f4c9b7-85d3-4c8b-8e13-23cd394fd75c tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] [instance: 836874db-02ab-4f3d-8b87-d32c70829b1b] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:23.919356 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-10f4c9b7-85d3-4c8b-8e13-23cd394fd75c tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:23.919802 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-10f4c9b7-85d3-4c8b-8e13-23cd394fd75c tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:23.920922 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-10f4c9b7-85d3-4c8b-8e13-23cd394fd75c tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:23.921523 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-10f4c9b7-85d3-4c8b-8e13-23cd394fd75c tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:24.149230 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-10f4c9b7-85d3-4c8b-8e13-23cd394fd75c tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19f6c089e7ec4ca5914d760e742d89b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329e95cbfdb9493d82941bc00dd1ccbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:24.157809 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-10f4c9b7-85d3-4c8b-8e13-23cd394fd75c tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] 10.222.0.55 "GET /compute/v2.1/servers/836874db-02ab-4f3d-8b87-d32c70829b1b" status: 200 len: 1319 microversion: 2.1 time: 0.250579 May 31 21:15:24.158742 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 530/1037] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:23 2022] GET /compute/v2.1/servers/836874db-02ab-4f3d-8b87-d32c70829b1b => generated 1319 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:15:24.175556 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-3188ec05-a2ef-46dd-8157-2652d2edfba5 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:24.176145 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-3188ec05-a2ef-46dd-8157-2652d2edfba5 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 5cb669a7-8e63-46ac-86f6-1be4050a44ec] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:24.183946 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-3188ec05-a2ef-46dd-8157-2652d2edfba5 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:24.184565 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-3188ec05-a2ef-46dd-8157-2652d2edfba5 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:24.185435 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-3188ec05-a2ef-46dd-8157-2652d2edfba5 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:24.185879 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-3188ec05-a2ef-46dd-8157-2652d2edfba5 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:24.274336 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.objects.instance [None req-3188ec05-a2ef-46dd-8157-2652d2edfba5 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lazy-loading 'services' on Instance uuid 5cb669a7-8e63-46ac-86f6-1be4050a44ec {{(pid=118185) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 21:15:24.514224 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-3188ec05-a2ef-46dd-8157-2652d2edfba5 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "DELETE /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec/os-volume_attachments/06c97b8d-40ba-4efc-baba-bc7096f3aa63" status: 202 len: 0 microversion: 2.1 time: 0.342928 May 31 21:15:24.514882 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 508/1038] 10.222.0.55 () {58 vars in 1415 bytes} [Tue May 31 21:15:24 2022] DELETE /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec/os-volume_attachments/06c97b8d-40ba-4efc-baba-bc7096f3aa63 => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 21:15:24.525520 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-bc4043df-cbff-460e-aa28-205e14aea888 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:24.527314 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-bc4043df-cbff-460e-aa28-205e14aea888 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 5cb669a7-8e63-46ac-86f6-1be4050a44ec] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:24.535432 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-bc4043df-cbff-460e-aa28-205e14aea888 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:24.535888 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-bc4043df-cbff-460e-aa28-205e14aea888 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:24.536712 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-bc4043df-cbff-460e-aa28-205e14aea888 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:24.537145 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-bc4043df-cbff-460e-aa28-205e14aea888 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:24.568402 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-bc4043df-cbff-460e-aa28-205e14aea888 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048270 May 31 21:15:24.568966 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 531/1039] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 31 21:15:24 2022] GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:15:24.645637 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-ac636266-b356-42a9-a0cc-92f174ef1a24 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:24.646854 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-ac636266-b356-42a9-a0cc-92f174ef1a24 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] [instance: 45453898-e1e4-44bb-8af5-3a1729aa2870] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:24.654467 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ac636266-b356-42a9-a0cc-92f174ef1a24 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:24.655145 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ac636266-b356-42a9-a0cc-92f174ef1a24 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:24.655969 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ac636266-b356-42a9-a0cc-92f174ef1a24 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:24.656768 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ac636266-b356-42a9-a0cc-92f174ef1a24 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:24.799292 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-ac636266-b356-42a9-a0cc-92f174ef1a24 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782845f8e6a440b684ae46a6ed118a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c46b1e7a32484b9c22387f2aaeb871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:24.808324 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-ac636266-b356-42a9-a0cc-92f174ef1a24 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] 10.222.0.55 "GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870" status: 200 len: 1261 microversion: 2.1 time: 0.168239 May 31 21:15:24.808894 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 509/1040] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:24 2022] GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870 => generated 1261 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:15:25.175269 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-feb32ef6-1117-4c25-976d-9a15a82e2b62 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:25.175914 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-feb32ef6-1117-4c25-976d-9a15a82e2b62 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] [instance: 836874db-02ab-4f3d-8b87-d32c70829b1b] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:25.182479 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-feb32ef6-1117-4c25-976d-9a15a82e2b62 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:25.182922 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-feb32ef6-1117-4c25-976d-9a15a82e2b62 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:25.183678 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-feb32ef6-1117-4c25-976d-9a15a82e2b62 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:25.184109 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-feb32ef6-1117-4c25-976d-9a15a82e2b62 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:25.310109 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-feb32ef6-1117-4c25-976d-9a15a82e2b62 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19f6c089e7ec4ca5914d760e742d89b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329e95cbfdb9493d82941bc00dd1ccbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:25.317497 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-feb32ef6-1117-4c25-976d-9a15a82e2b62 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] 10.222.0.55 "GET /compute/v2.1/servers/836874db-02ab-4f3d-8b87-d32c70829b1b" status: 200 len: 1319 microversion: 2.1 time: 0.146210 May 31 21:15:25.318083 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 532/1041] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:25 2022] GET /compute/v2.1/servers/836874db-02ab-4f3d-8b87-d32c70829b1b => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:15:25.580329 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-af413afc-1f54-4c24-87bc-a868166f8b22 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:25.581320 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-af413afc-1f54-4c24-87bc-a868166f8b22 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 5cb669a7-8e63-46ac-86f6-1be4050a44ec] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:25.588479 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-af413afc-1f54-4c24-87bc-a868166f8b22 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:25.588931 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-af413afc-1f54-4c24-87bc-a868166f8b22 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:25.589700 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-af413afc-1f54-4c24-87bc-a868166f8b22 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:25.590168 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-af413afc-1f54-4c24-87bc-a868166f8b22 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:25.620141 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-af413afc-1f54-4c24-87bc-a868166f8b22 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044081 May 31 21:15:25.620689 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 510/1042] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 31 21:15:25 2022] GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:15:25.825108 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-73cceb85-1eac-421e-814e-835f813d7711 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:25.825719 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-73cceb85-1eac-421e-814e-835f813d7711 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] [instance: 45453898-e1e4-44bb-8af5-3a1729aa2870] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:25.832240 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-73cceb85-1eac-421e-814e-835f813d7711 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:25.832632 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-73cceb85-1eac-421e-814e-835f813d7711 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:25.833395 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-73cceb85-1eac-421e-814e-835f813d7711 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:25.833827 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-73cceb85-1eac-421e-814e-835f813d7711 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:25.849185 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [req-c92f1104-cf4c-4782-b72b-9019a8122564 req-c66f38cd-1cb1-4464-a546-c11ba66c5124 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "836874db-02ab-4f3d-8b87-d32c70829b1b", "tag": "43ac5025-cbec-4c3e-a75a-05a41cfb775f"}]} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:15:25.857700 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-c92f1104-cf4c-4782-b72b-9019a8122564 req-c66f38cd-1cb1-4464-a546-c11ba66c5124 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:25.858237 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-c92f1104-cf4c-4782-b72b-9019a8122564 req-c66f38cd-1cb1-4464-a546-c11ba66c5124 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:25.869759 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.compute.server_external_events [req-c92f1104-cf4c-4782-b72b-9019a8122564 req-c66f38cd-1cb1-4464-a546-c11ba66c5124 service nova] Creating event network-changed:43ac5025-cbec-4c3e-a75a-05a41cfb775f for instance 836874db-02ab-4f3d-8b87-d32c70829b1b on hv-cinder-83979 May 31 21:15:25.874449 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [req-c92f1104-cf4c-4782-b72b-9019a8122564 req-c66f38cd-1cb1-4464-a546-c11ba66c5124 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029000 May 31 21:15:25.875038 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 511/1043] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 21:15:25.968273 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-73cceb85-1eac-421e-814e-835f813d7711 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782845f8e6a440b684ae46a6ed118a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c46b1e7a32484b9c22387f2aaeb871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:25.975828 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-73cceb85-1eac-421e-814e-835f813d7711 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] 10.222.0.55 "GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870" status: 200 len: 1261 microversion: 2.1 time: 0.154584 May 31 21:15:25.976392 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 533/1044] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:25 2022] GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870 => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:15:26.335337 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-12d5face-3538-459d-8c07-d4124f072e9c tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:26.336102 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-12d5face-3538-459d-8c07-d4124f072e9c tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] [instance: 836874db-02ab-4f3d-8b87-d32c70829b1b] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:26.342398 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-12d5face-3538-459d-8c07-d4124f072e9c tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:26.342845 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-12d5face-3538-459d-8c07-d4124f072e9c tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:26.343680 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-12d5face-3538-459d-8c07-d4124f072e9c tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:26.344309 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-12d5face-3538-459d-8c07-d4124f072e9c tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:26.474733 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-12d5face-3538-459d-8c07-d4124f072e9c tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19f6c089e7ec4ca5914d760e742d89b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329e95cbfdb9493d82941bc00dd1ccbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:26.482169 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-12d5face-3538-459d-8c07-d4124f072e9c tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] 10.222.0.55 "GET /compute/v2.1/servers/836874db-02ab-4f3d-8b87-d32c70829b1b" status: 200 len: 1319 microversion: 2.1 time: 0.151100 May 31 21:15:26.482740 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 512/1045] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:26 2022] GET /compute/v2.1/servers/836874db-02ab-4f3d-8b87-d32c70829b1b => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:15:26.631979 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-446df65a-9e16-4196-a7d3-7d580df655d6 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:26.632971 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-446df65a-9e16-4196-a7d3-7d580df655d6 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 5cb669a7-8e63-46ac-86f6-1be4050a44ec] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:26.639655 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-446df65a-9e16-4196-a7d3-7d580df655d6 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:26.640106 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-446df65a-9e16-4196-a7d3-7d580df655d6 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:26.640877 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-446df65a-9e16-4196-a7d3-7d580df655d6 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:26.641316 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-446df65a-9e16-4196-a7d3-7d580df655d6 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:26.671684 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-446df65a-9e16-4196-a7d3-7d580df655d6 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043740 May 31 21:15:26.672314 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 534/1046] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 31 21:15:26 2022] GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:15:26.992527 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-5af12dfd-a604-4322-aac9-3a74ba9b4f3b tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:26.993161 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-5af12dfd-a604-4322-aac9-3a74ba9b4f3b tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] [instance: 45453898-e1e4-44bb-8af5-3a1729aa2870] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:26.999653 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-5af12dfd-a604-4322-aac9-3a74ba9b4f3b tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:27.000101 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-5af12dfd-a604-4322-aac9-3a74ba9b4f3b tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:27.000864 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-5af12dfd-a604-4322-aac9-3a74ba9b4f3b tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:27.001301 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-5af12dfd-a604-4322-aac9-3a74ba9b4f3b tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:27.032296 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell0:SELECT=2 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:15:27.132273 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-5af12dfd-a604-4322-aac9-3a74ba9b4f3b tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782845f8e6a440b684ae46a6ed118a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c46b1e7a32484b9c22387f2aaeb871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:27.139670 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-5af12dfd-a604-4322-aac9-3a74ba9b4f3b tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] 10.222.0.55 "GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870" status: 200 len: 1261 microversion: 2.1 time: 0.151006 May 31 21:15:27.140226 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 513/1047] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:26 2022] GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870 => generated 1261 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:15:27.499061 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-47eaec78-3d21-4838-b54e-4b30d19a4c73 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:27.499660 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-47eaec78-3d21-4838-b54e-4b30d19a4c73 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] [instance: 836874db-02ab-4f3d-8b87-d32c70829b1b] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:27.506393 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-47eaec78-3d21-4838-b54e-4b30d19a4c73 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:27.506839 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-47eaec78-3d21-4838-b54e-4b30d19a4c73 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:27.507597 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-47eaec78-3d21-4838-b54e-4b30d19a4c73 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:27.508025 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-47eaec78-3d21-4838-b54e-4b30d19a4c73 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:27.636642 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-47eaec78-3d21-4838-b54e-4b30d19a4c73 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19f6c089e7ec4ca5914d760e742d89b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329e95cbfdb9493d82941bc00dd1ccbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:27.644933 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-47eaec78-3d21-4838-b54e-4b30d19a4c73 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] 10.222.0.55 "GET /compute/v2.1/servers/836874db-02ab-4f3d-8b87-d32c70829b1b" status: 200 len: 1319 microversion: 2.1 time: 0.149673 May 31 21:15:27.645618 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 535/1048] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:27 2022] GET /compute/v2.1/servers/836874db-02ab-4f3d-8b87-d32c70829b1b => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:15:27.684107 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-0cec1744-87f8-4216-89d2-24363205b01e tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:27.685092 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-0cec1744-87f8-4216-89d2-24363205b01e tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 5cb669a7-8e63-46ac-86f6-1be4050a44ec] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:27.691289 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-0cec1744-87f8-4216-89d2-24363205b01e tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:27.691739 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-0cec1744-87f8-4216-89d2-24363205b01e tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:27.692506 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-0cec1744-87f8-4216-89d2-24363205b01e tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:27.692946 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-0cec1744-87f8-4216-89d2-24363205b01e tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:27.721913 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-0cec1744-87f8-4216-89d2-24363205b01e tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041657 May 31 21:15:27.722467 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 514/1049] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 31 21:15:27 2022] GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:15:28.157199 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-35c0dbe4-769f-467f-a49a-56cb8909c3f4 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:28.157723 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-35c0dbe4-769f-467f-a49a-56cb8909c3f4 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] [instance: 45453898-e1e4-44bb-8af5-3a1729aa2870] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:28.164394 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-35c0dbe4-769f-467f-a49a-56cb8909c3f4 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:28.164837 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-35c0dbe4-769f-467f-a49a-56cb8909c3f4 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:28.165590 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-35c0dbe4-769f-467f-a49a-56cb8909c3f4 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:28.166050 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-35c0dbe4-769f-467f-a49a-56cb8909c3f4 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:28.294809 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-35c0dbe4-769f-467f-a49a-56cb8909c3f4 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782845f8e6a440b684ae46a6ed118a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c46b1e7a32484b9c22387f2aaeb871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:28.302294 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-35c0dbe4-769f-467f-a49a-56cb8909c3f4 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] 10.222.0.55 "GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870" status: 200 len: 1261 microversion: 2.1 time: 0.149083 May 31 21:15:28.302891 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 536/1050] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:28 2022] GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870 => generated 1261 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:15:28.661452 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-508f9ac6-20c1-401a-a186-6bc489497bd5 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:28.662095 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-508f9ac6-20c1-401a-a186-6bc489497bd5 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] [instance: 836874db-02ab-4f3d-8b87-d32c70829b1b] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:28.669123 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-508f9ac6-20c1-401a-a186-6bc489497bd5 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:28.669595 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-508f9ac6-20c1-401a-a186-6bc489497bd5 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:28.670388 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-508f9ac6-20c1-401a-a186-6bc489497bd5 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:28.670830 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-508f9ac6-20c1-401a-a186-6bc489497bd5 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:28.734214 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-a768f7e0-23f1-4a5d-b1bb-f12b26dc284c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:28.735137 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-a768f7e0-23f1-4a5d-b1bb-f12b26dc284c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 5cb669a7-8e63-46ac-86f6-1be4050a44ec] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:28.742474 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a768f7e0-23f1-4a5d-b1bb-f12b26dc284c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:28.742929 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a768f7e0-23f1-4a5d-b1bb-f12b26dc284c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:28.743713 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a768f7e0-23f1-4a5d-b1bb-f12b26dc284c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:28.744213 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a768f7e0-23f1-4a5d-b1bb-f12b26dc284c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:28.770013 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell1:SELECT=100 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:15:28.775083 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-a768f7e0-23f1-4a5d-b1bb-f12b26dc284c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044977 May 31 21:15:28.775668 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 537/1051] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 31 21:15:28 2022] GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 21:15:28.803828 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-508f9ac6-20c1-401a-a186-6bc489497bd5 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19f6c089e7ec4ca5914d760e742d89b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329e95cbfdb9493d82941bc00dd1ccbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:28.807252 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:15:28.811461 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-508f9ac6-20c1-401a-a186-6bc489497bd5 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] 10.222.0.55 "GET /compute/v2.1/servers/836874db-02ab-4f3d-8b87-d32c70829b1b" status: 200 len: 1319 microversion: 2.1 time: 0.153874 May 31 21:15:28.812018 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 515/1052] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:28 2022] GET /compute/v2.1/servers/836874db-02ab-4f3d-8b87-d32c70829b1b => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:15:29.319937 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-a3ec2ad9-bb97-4644-b5be-31632453ebae tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:29.320554 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-a3ec2ad9-bb97-4644-b5be-31632453ebae tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] [instance: 45453898-e1e4-44bb-8af5-3a1729aa2870] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:29.327029 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a3ec2ad9-bb97-4644-b5be-31632453ebae tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:29.327473 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a3ec2ad9-bb97-4644-b5be-31632453ebae tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:29.328223 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a3ec2ad9-bb97-4644-b5be-31632453ebae tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:29.328914 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a3ec2ad9-bb97-4644-b5be-31632453ebae tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:29.329343 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell0:SELECT=2 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:15:29.350033 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell0:SELECT=8 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:15:29.457566 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-a3ec2ad9-bb97-4644-b5be-31632453ebae tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782845f8e6a440b684ae46a6ed118a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c46b1e7a32484b9c22387f2aaeb871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:29.465633 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-a3ec2ad9-bb97-4644-b5be-31632453ebae tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] 10.222.0.55 "GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870" status: 200 len: 1261 microversion: 2.1 time: 0.150406 May 31 21:15:29.466219 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 538/1053] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:29 2022] GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870 => generated 1261 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:15:29.786762 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-b9cf6311-a3fa-48c9-b919-d4ba243c890e tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:29.787691 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-b9cf6311-a3fa-48c9-b919-d4ba243c890e tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 5cb669a7-8e63-46ac-86f6-1be4050a44ec] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:29.789919 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell0:SELECT=10 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:15:29.795632 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b9cf6311-a3fa-48c9-b919-d4ba243c890e tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:29.799286 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b9cf6311-a3fa-48c9-b919-d4ba243c890e tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:29.799286 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b9cf6311-a3fa-48c9-b919-d4ba243c890e tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:29.799286 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b9cf6311-a3fa-48c9-b919-d4ba243c890e tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:29.827443 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-b9cf6311-a3fa-48c9-b919-d4ba243c890e tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044658 May 31 21:15:29.828010 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 516/1054] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 31 21:15:29 2022] GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:15:29.828178 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-322f3f1a-7ee2-43b8-bed8-94944c24d99d tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:29.829030 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-322f3f1a-7ee2-43b8-bed8-94944c24d99d tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] [instance: 836874db-02ab-4f3d-8b87-d32c70829b1b] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:29.835549 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-322f3f1a-7ee2-43b8-bed8-94944c24d99d tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:29.835991 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-322f3f1a-7ee2-43b8-bed8-94944c24d99d tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:29.836756 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-322f3f1a-7ee2-43b8-bed8-94944c24d99d tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:29.837192 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-322f3f1a-7ee2-43b8-bed8-94944c24d99d tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:29.966260 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-322f3f1a-7ee2-43b8-bed8-94944c24d99d tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19f6c089e7ec4ca5914d760e742d89b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329e95cbfdb9493d82941bc00dd1ccbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:29.973617 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-322f3f1a-7ee2-43b8-bed8-94944c24d99d tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] 10.222.0.55 "GET /compute/v2.1/servers/836874db-02ab-4f3d-8b87-d32c70829b1b" status: 200 len: 1319 microversion: 2.1 time: 0.149399 May 31 21:15:29.974203 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 539/1055] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:29 2022] GET /compute/v2.1/servers/836874db-02ab-4f3d-8b87-d32c70829b1b => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:15:30.482679 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-cb8147b5-f583-4a97-a205-ea57e6a38322 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:30.483296 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-cb8147b5-f583-4a97-a205-ea57e6a38322 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] [instance: 45453898-e1e4-44bb-8af5-3a1729aa2870] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:30.490066 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-cb8147b5-f583-4a97-a205-ea57e6a38322 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:30.490522 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-cb8147b5-f583-4a97-a205-ea57e6a38322 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:30.491343 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-cb8147b5-f583-4a97-a205-ea57e6a38322 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:30.491732 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-cb8147b5-f583-4a97-a205-ea57e6a38322 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:30.619935 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-cb8147b5-f583-4a97-a205-ea57e6a38322 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782845f8e6a440b684ae46a6ed118a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c46b1e7a32484b9c22387f2aaeb871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:30.627526 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-cb8147b5-f583-4a97-a205-ea57e6a38322 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] 10.222.0.55 "GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870" status: 200 len: 1261 microversion: 2.1 time: 0.148864 May 31 21:15:30.628090 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 517/1056] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:30 2022] GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870 => generated 1261 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:15:30.840095 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-40eee669-7b38-4311-a71d-509b48a3904e tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:30.841015 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-40eee669-7b38-4311-a71d-509b48a3904e tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 5cb669a7-8e63-46ac-86f6-1be4050a44ec] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:30.847484 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-40eee669-7b38-4311-a71d-509b48a3904e tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:30.847932 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-40eee669-7b38-4311-a71d-509b48a3904e tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:30.848690 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-40eee669-7b38-4311-a71d-509b48a3904e tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:30.849124 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-40eee669-7b38-4311-a71d-509b48a3904e tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:30.876668 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-40eee669-7b38-4311-a71d-509b48a3904e tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040528 May 31 21:15:30.877158 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 540/1057] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 31 21:15:30 2022] GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:15:30.991483 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-e05bc3ab-e4ba-4bc1-a5c5-b1b97dfb7696 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:30.992118 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-e05bc3ab-e4ba-4bc1-a5c5-b1b97dfb7696 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] [instance: 836874db-02ab-4f3d-8b87-d32c70829b1b] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:30.998552 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e05bc3ab-e4ba-4bc1-a5c5-b1b97dfb7696 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:30.998995 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e05bc3ab-e4ba-4bc1-a5c5-b1b97dfb7696 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:30.999752 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e05bc3ab-e4ba-4bc1-a5c5-b1b97dfb7696 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:31.000182 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e05bc3ab-e4ba-4bc1-a5c5-b1b97dfb7696 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:31.126151 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-e05bc3ab-e4ba-4bc1-a5c5-b1b97dfb7696 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19f6c089e7ec4ca5914d760e742d89b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329e95cbfdb9493d82941bc00dd1ccbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:31.134273 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-e05bc3ab-e4ba-4bc1-a5c5-b1b97dfb7696 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] 10.222.0.55 "GET /compute/v2.1/servers/836874db-02ab-4f3d-8b87-d32c70829b1b" status: 200 len: 1319 microversion: 2.1 time: 0.147308 May 31 21:15:31.134867 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 518/1058] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:30 2022] GET /compute/v2.1/servers/836874db-02ab-4f3d-8b87-d32c70829b1b => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:15:31.644577 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-10203e47-21cc-46c1-8492-2857e985b13b tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:31.645175 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-10203e47-21cc-46c1-8492-2857e985b13b tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] [instance: 45453898-e1e4-44bb-8af5-3a1729aa2870] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:31.651249 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-10203e47-21cc-46c1-8492-2857e985b13b tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:31.651691 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-10203e47-21cc-46c1-8492-2857e985b13b tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:31.652443 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-10203e47-21cc-46c1-8492-2857e985b13b tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:31.652873 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-10203e47-21cc-46c1-8492-2857e985b13b tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:31.787187 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-10203e47-21cc-46c1-8492-2857e985b13b tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782845f8e6a440b684ae46a6ed118a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c46b1e7a32484b9c22387f2aaeb871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:31.797742 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-10203e47-21cc-46c1-8492-2857e985b13b tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] 10.222.0.55 "GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870" status: 200 len: 1261 microversion: 2.1 time: 0.156913 May 31 21:15:31.798377 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 541/1059] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:31 2022] GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870 => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:15:31.888655 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-19a52e65-4762-4e37-a4c7-8882f064f29a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:31.889582 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-19a52e65-4762-4e37-a4c7-8882f064f29a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 5cb669a7-8e63-46ac-86f6-1be4050a44ec] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:31.895635 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-19a52e65-4762-4e37-a4c7-8882f064f29a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:31.896087 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-19a52e65-4762-4e37-a4c7-8882f064f29a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:31.896853 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-19a52e65-4762-4e37-a4c7-8882f064f29a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:31.897811 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-19a52e65-4762-4e37-a4c7-8882f064f29a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:31.929066 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-19a52e65-4762-4e37-a4c7-8882f064f29a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043859 May 31 21:15:31.929646 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 519/1060] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 31 21:15:31 2022] GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 21:15:32.150975 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-24554f09-96ca-4c37-9350-f72e81cfc22d tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:32.151520 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-24554f09-96ca-4c37-9350-f72e81cfc22d tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] [instance: 836874db-02ab-4f3d-8b87-d32c70829b1b] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:32.157882 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-24554f09-96ca-4c37-9350-f72e81cfc22d tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:32.158348 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-24554f09-96ca-4c37-9350-f72e81cfc22d tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:32.159102 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-24554f09-96ca-4c37-9350-f72e81cfc22d tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:32.159534 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-24554f09-96ca-4c37-9350-f72e81cfc22d tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:32.288342 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-24554f09-96ca-4c37-9350-f72e81cfc22d tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19f6c089e7ec4ca5914d760e742d89b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329e95cbfdb9493d82941bc00dd1ccbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:32.295756 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-24554f09-96ca-4c37-9350-f72e81cfc22d tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] 10.222.0.55 "GET /compute/v2.1/servers/836874db-02ab-4f3d-8b87-d32c70829b1b" status: 200 len: 1319 microversion: 2.1 time: 0.148696 May 31 21:15:32.296322 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 542/1061] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:32 2022] GET /compute/v2.1/servers/836874db-02ab-4f3d-8b87-d32c70829b1b => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:15:32.814332 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-9c38728f-3b1b-4e5a-b8b7-fd8e834565aa tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:32.814945 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-9c38728f-3b1b-4e5a-b8b7-fd8e834565aa tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] [instance: 45453898-e1e4-44bb-8af5-3a1729aa2870] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:32.821354 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9c38728f-3b1b-4e5a-b8b7-fd8e834565aa tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:32.821805 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9c38728f-3b1b-4e5a-b8b7-fd8e834565aa tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:32.822602 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9c38728f-3b1b-4e5a-b8b7-fd8e834565aa tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:32.823072 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9c38728f-3b1b-4e5a-b8b7-fd8e834565aa tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:32.940677 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-a27d87a9-42da-45d8-b543-4cabfd95ac66 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:32.941608 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-a27d87a9-42da-45d8-b543-4cabfd95ac66 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 5cb669a7-8e63-46ac-86f6-1be4050a44ec] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:32.949439 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a27d87a9-42da-45d8-b543-4cabfd95ac66 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:32.949903 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a27d87a9-42da-45d8-b543-4cabfd95ac66 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:32.950691 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a27d87a9-42da-45d8-b543-4cabfd95ac66 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:32.951203 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a27d87a9-42da-45d8-b543-4cabfd95ac66 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:32.953945 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-9c38728f-3b1b-4e5a-b8b7-fd8e834565aa tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782845f8e6a440b684ae46a6ed118a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c46b1e7a32484b9c22387f2aaeb871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:32.962117 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-9c38728f-3b1b-4e5a-b8b7-fd8e834565aa tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] 10.222.0.55 "GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870" status: 200 len: 1261 microversion: 2.1 time: 0.151590 May 31 21:15:32.962694 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 520/1062] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:32 2022] GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870 => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:15:32.981861 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-a27d87a9-42da-45d8-b543-4cabfd95ac66 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045074 May 31 21:15:32.982441 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 543/1063] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 31 21:15:32 2022] GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 21:15:33.312696 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-94daa78f-52d5-4eab-9cdf-c4e1d2e846eb tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:33.313307 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-94daa78f-52d5-4eab-9cdf-c4e1d2e846eb tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] [instance: 836874db-02ab-4f3d-8b87-d32c70829b1b] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:33.320105 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-94daa78f-52d5-4eab-9cdf-c4e1d2e846eb tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:33.320561 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-94daa78f-52d5-4eab-9cdf-c4e1d2e846eb tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:33.321338 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-94daa78f-52d5-4eab-9cdf-c4e1d2e846eb tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:33.321780 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-94daa78f-52d5-4eab-9cdf-c4e1d2e846eb tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:33.447407 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-94daa78f-52d5-4eab-9cdf-c4e1d2e846eb tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19f6c089e7ec4ca5914d760e742d89b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329e95cbfdb9493d82941bc00dd1ccbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:33.454998 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-94daa78f-52d5-4eab-9cdf-c4e1d2e846eb tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] 10.222.0.55 "GET /compute/v2.1/servers/836874db-02ab-4f3d-8b87-d32c70829b1b" status: 200 len: 1319 microversion: 2.1 time: 0.146192 May 31 21:15:33.455558 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 521/1064] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:33 2022] GET /compute/v2.1/servers/836874db-02ab-4f3d-8b87-d32c70829b1b => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:15:33.979566 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-4d07e9c8-e590-430c-97fa-1cc3ef1f88d5 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:33.980107 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-4d07e9c8-e590-430c-97fa-1cc3ef1f88d5 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] [instance: 45453898-e1e4-44bb-8af5-3a1729aa2870] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:33.986713 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4d07e9c8-e590-430c-97fa-1cc3ef1f88d5 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:33.987241 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4d07e9c8-e590-430c-97fa-1cc3ef1f88d5 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:33.987924 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4d07e9c8-e590-430c-97fa-1cc3ef1f88d5 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:33.988359 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4d07e9c8-e590-430c-97fa-1cc3ef1f88d5 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:33.993228 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-0013d412-8be4-4761-9285-b48502a4e3a2 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:33.994318 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-0013d412-8be4-4761-9285-b48502a4e3a2 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 5cb669a7-8e63-46ac-86f6-1be4050a44ec] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:34.000786 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-0013d412-8be4-4761-9285-b48502a4e3a2 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:34.001236 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-0013d412-8be4-4761-9285-b48502a4e3a2 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:34.002031 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-0013d412-8be4-4761-9285-b48502a4e3a2 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:34.002465 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-0013d412-8be4-4761-9285-b48502a4e3a2 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:34.031837 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-0013d412-8be4-4761-9285-b48502a4e3a2 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043125 May 31 21:15:34.032409 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 522/1065] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 31 21:15:33 2022] GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:15:34.122228 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-4d07e9c8-e590-430c-97fa-1cc3ef1f88d5 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782845f8e6a440b684ae46a6ed118a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c46b1e7a32484b9c22387f2aaeb871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:34.129750 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-4d07e9c8-e590-430c-97fa-1cc3ef1f88d5 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] 10.222.0.55 "GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870" status: 200 len: 1261 microversion: 2.1 time: 0.154711 May 31 21:15:34.130355 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 544/1066] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:33 2022] GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870 => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:15:34.472982 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-385e4177-faed-4ce2-a281-7e4daebfd43a tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:34.473582 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-385e4177-faed-4ce2-a281-7e4daebfd43a tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] [instance: 836874db-02ab-4f3d-8b87-d32c70829b1b] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:34.479601 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-385e4177-faed-4ce2-a281-7e4daebfd43a tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:34.480049 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-385e4177-faed-4ce2-a281-7e4daebfd43a tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:34.480818 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-385e4177-faed-4ce2-a281-7e4daebfd43a tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:34.481258 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-385e4177-faed-4ce2-a281-7e4daebfd43a tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:34.606672 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-385e4177-faed-4ce2-a281-7e4daebfd43a tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19f6c089e7ec4ca5914d760e742d89b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329e95cbfdb9493d82941bc00dd1ccbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:34.614246 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-385e4177-faed-4ce2-a281-7e4daebfd43a tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] 10.222.0.55 "GET /compute/v2.1/servers/836874db-02ab-4f3d-8b87-d32c70829b1b" status: 200 len: 1319 microversion: 2.1 time: 0.145108 May 31 21:15:34.614985 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 523/1067] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:34 2022] GET /compute/v2.1/servers/836874db-02ab-4f3d-8b87-d32c70829b1b => generated 1319 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:15:35.043447 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-42d4f931-d781-47b3-b3e9-dd087a85d9a9 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:35.044369 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-42d4f931-d781-47b3-b3e9-dd087a85d9a9 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 5cb669a7-8e63-46ac-86f6-1be4050a44ec] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:35.050792 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-42d4f931-d781-47b3-b3e9-dd087a85d9a9 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:35.051233 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-42d4f931-d781-47b3-b3e9-dd087a85d9a9 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:35.051991 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-42d4f931-d781-47b3-b3e9-dd087a85d9a9 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:35.052422 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-42d4f931-d781-47b3-b3e9-dd087a85d9a9 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:35.081724 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-42d4f931-d781-47b3-b3e9-dd087a85d9a9 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042264 May 31 21:15:35.082311 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 545/1068] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 31 21:15:35 2022] GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:15:35.146583 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-b1f76567-8e06-4181-932c-bff0d309bccc tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:35.147425 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-b1f76567-8e06-4181-932c-bff0d309bccc tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] [instance: 45453898-e1e4-44bb-8af5-3a1729aa2870] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:35.154137 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b1f76567-8e06-4181-932c-bff0d309bccc tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:35.154667 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b1f76567-8e06-4181-932c-bff0d309bccc tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:35.155504 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b1f76567-8e06-4181-932c-bff0d309bccc tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:35.156021 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b1f76567-8e06-4181-932c-bff0d309bccc tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:35.332249 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-b1f76567-8e06-4181-932c-bff0d309bccc tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782845f8e6a440b684ae46a6ed118a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c46b1e7a32484b9c22387f2aaeb871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:35.339823 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-b1f76567-8e06-4181-932c-bff0d309bccc tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] 10.222.0.55 "GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870" status: 200 len: 1261 microversion: 2.1 time: 0.197175 May 31 21:15:35.340580 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 524/1069] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:35 2022] GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870 => generated 1261 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:15:35.631699 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-b20b84bf-37f3-43cd-9218-76eeb4e07eb5 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:35.632229 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-b20b84bf-37f3-43cd-9218-76eeb4e07eb5 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] [instance: 836874db-02ab-4f3d-8b87-d32c70829b1b] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:35.638267 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b20b84bf-37f3-43cd-9218-76eeb4e07eb5 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:35.638716 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b20b84bf-37f3-43cd-9218-76eeb4e07eb5 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:35.639476 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b20b84bf-37f3-43cd-9218-76eeb4e07eb5 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:35.639910 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b20b84bf-37f3-43cd-9218-76eeb4e07eb5 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:35.768513 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-b20b84bf-37f3-43cd-9218-76eeb4e07eb5 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19f6c089e7ec4ca5914d760e742d89b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329e95cbfdb9493d82941bc00dd1ccbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:35.776467 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-b20b84bf-37f3-43cd-9218-76eeb4e07eb5 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] 10.222.0.55 "GET /compute/v2.1/servers/836874db-02ab-4f3d-8b87-d32c70829b1b" status: 200 len: 1319 microversion: 2.1 time: 0.148734 May 31 21:15:35.777037 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 546/1070] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:35 2022] GET /compute/v2.1/servers/836874db-02ab-4f3d-8b87-d32c70829b1b => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:15:36.093389 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-f7e5c584-2c8a-4172-8888-c0f1b53006c6 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:36.094612 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-f7e5c584-2c8a-4172-8888-c0f1b53006c6 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 5cb669a7-8e63-46ac-86f6-1be4050a44ec] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:36.100772 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f7e5c584-2c8a-4172-8888-c0f1b53006c6 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:36.101222 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f7e5c584-2c8a-4172-8888-c0f1b53006c6 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:36.102010 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f7e5c584-2c8a-4172-8888-c0f1b53006c6 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:36.102445 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f7e5c584-2c8a-4172-8888-c0f1b53006c6 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:36.133279 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-f7e5c584-2c8a-4172-8888-c0f1b53006c6 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043777 May 31 21:15:36.134067 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 525/1071] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 31 21:15:36 2022] GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:15:36.357125 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-aa36d8e9-41b8-45d4-b41e-bd43ba93fcdd tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:36.359801 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-aa36d8e9-41b8-45d4-b41e-bd43ba93fcdd tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] [instance: 45453898-e1e4-44bb-8af5-3a1729aa2870] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:36.365282 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-aa36d8e9-41b8-45d4-b41e-bd43ba93fcdd tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:36.366522 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-aa36d8e9-41b8-45d4-b41e-bd43ba93fcdd tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:36.367407 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-aa36d8e9-41b8-45d4-b41e-bd43ba93fcdd tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:36.367835 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-aa36d8e9-41b8-45d4-b41e-bd43ba93fcdd tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:36.506176 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-aa36d8e9-41b8-45d4-b41e-bd43ba93fcdd tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782845f8e6a440b684ae46a6ed118a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c46b1e7a32484b9c22387f2aaeb871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:36.514721 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-aa36d8e9-41b8-45d4-b41e-bd43ba93fcdd tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] 10.222.0.55 "GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870" status: 200 len: 1261 microversion: 2.1 time: 0.161806 May 31 21:15:36.515308 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 547/1072] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:36 2022] GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870 => generated 1261 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:15:36.793207 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-69dd0892-932d-406d-88e6-35619f534bc7 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:36.793784 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-69dd0892-932d-406d-88e6-35619f534bc7 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] [instance: 836874db-02ab-4f3d-8b87-d32c70829b1b] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:36.800125 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-69dd0892-932d-406d-88e6-35619f534bc7 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:36.800555 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-69dd0892-932d-406d-88e6-35619f534bc7 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:36.801323 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-69dd0892-932d-406d-88e6-35619f534bc7 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:36.801760 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-69dd0892-932d-406d-88e6-35619f534bc7 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:36.934952 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-69dd0892-932d-406d-88e6-35619f534bc7 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19f6c089e7ec4ca5914d760e742d89b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329e95cbfdb9493d82941bc00dd1ccbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:36.942346 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-69dd0892-932d-406d-88e6-35619f534bc7 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] 10.222.0.55 "GET /compute/v2.1/servers/836874db-02ab-4f3d-8b87-d32c70829b1b" status: 200 len: 1319 microversion: 2.1 time: 0.152974 May 31 21:15:36.942909 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 526/1073] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:36 2022] GET /compute/v2.1/servers/836874db-02ab-4f3d-8b87-d32c70829b1b => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:15:37.144749 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-b73ce518-d867-4ee3-9b19-ac248d327f2a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:37.145587 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-b73ce518-d867-4ee3-9b19-ac248d327f2a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 5cb669a7-8e63-46ac-86f6-1be4050a44ec] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:37.152180 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b73ce518-d867-4ee3-9b19-ac248d327f2a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:37.152627 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b73ce518-d867-4ee3-9b19-ac248d327f2a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:37.153391 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b73ce518-d867-4ee3-9b19-ac248d327f2a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:37.153823 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b73ce518-d867-4ee3-9b19-ac248d327f2a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:37.183293 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-b73ce518-d867-4ee3-9b19-ac248d327f2a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042534 May 31 21:15:37.183881 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 548/1074] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 31 21:15:37 2022] GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 31 21:15:37.240200 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-8094cab9-ae1d-4f51-bc3d-b6a9aeed56b7 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:37.240979 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-8094cab9-ae1d-4f51-bc3d-b6a9aeed56b7 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 5cb669a7-8e63-46ac-86f6-1be4050a44ec] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:37.247374 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-8094cab9-ae1d-4f51-bc3d-b6a9aeed56b7 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:37.247853 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-8094cab9-ae1d-4f51-bc3d-b6a9aeed56b7 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:37.248579 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-8094cab9-ae1d-4f51-bc3d-b6a9aeed56b7 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:37.249007 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-8094cab9-ae1d-4f51-bc3d-b6a9aeed56b7 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:37.273931 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-8094cab9-ae1d-4f51-bc3d-b6a9aeed56b7 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 5cb669a7-8e63-46ac-86f6-1be4050a44ec] Going to try to terminate instance {{(pid=118185) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 21:15:37.466811 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:15:37.531716 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-ec2e385c-84c4-4f8e-a877-8ab338202c61 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:37.532320 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-ec2e385c-84c4-4f8e-a877-8ab338202c61 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] [instance: 45453898-e1e4-44bb-8af5-3a1729aa2870] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:37.538715 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ec2e385c-84c4-4f8e-a877-8ab338202c61 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:37.539158 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ec2e385c-84c4-4f8e-a877-8ab338202c61 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:37.539912 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ec2e385c-84c4-4f8e-a877-8ab338202c61 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:37.540394 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ec2e385c-84c4-4f8e-a877-8ab338202c61 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:37.565977 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-8094cab9-ae1d-4f51-bc3d-b6a9aeed56b7 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "DELETE /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec" status: 204 len: 0 microversion: 2.1 time: 0.329144 May 31 21:15:37.566820 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 527/1075] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 31 21:15:37 2022] DELETE /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 31 21:15:37.576585 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-9b2c5d1f-31c9-4ec6-9d6a-5c4452eec260 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:37.577288 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-9b2c5d1f-31c9-4ec6-9d6a-5c4452eec260 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 5cb669a7-8e63-46ac-86f6-1be4050a44ec] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:37.584211 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9b2c5d1f-31c9-4ec6-9d6a-5c4452eec260 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:37.585302 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9b2c5d1f-31c9-4ec6-9d6a-5c4452eec260 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:37.586159 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9b2c5d1f-31c9-4ec6-9d6a-5c4452eec260 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:37.586603 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9b2c5d1f-31c9-4ec6-9d6a-5c4452eec260 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:37.718615 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-ec2e385c-84c4-4f8e-a877-8ab338202c61 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782845f8e6a440b684ae46a6ed118a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c46b1e7a32484b9c22387f2aaeb871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:37.725977 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-ec2e385c-84c4-4f8e-a877-8ab338202c61 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] 10.222.0.55 "GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870" status: 200 len: 1261 microversion: 2.1 time: 0.198044 May 31 21:15:37.726546 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 549/1076] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:37 2022] GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870 => generated 1261 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:15:37.750509 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-9b2c5d1f-31c9-4ec6-9d6a-5c4452eec260 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe37a6d57b4775b4e47a295c3f5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b2364f40d14160adf0220d92adaad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:37.758435 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-9b2c5d1f-31c9-4ec6-9d6a-5c4452eec260 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec" status: 200 len: 1682 microversion: 2.1 time: 0.186504 May 31 21:15:37.759002 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 528/1077] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:37 2022] GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec => generated 1682 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:15:37.959555 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-efc32bbe-6291-42ed-ba2c-2e781f074c2e tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:37.960158 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-efc32bbe-6291-42ed-ba2c-2e781f074c2e tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] [instance: 836874db-02ab-4f3d-8b87-d32c70829b1b] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:37.966273 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-efc32bbe-6291-42ed-ba2c-2e781f074c2e tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:37.966719 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-efc32bbe-6291-42ed-ba2c-2e781f074c2e tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:37.967478 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-efc32bbe-6291-42ed-ba2c-2e781f074c2e tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:37.967907 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-efc32bbe-6291-42ed-ba2c-2e781f074c2e tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:38.094501 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-efc32bbe-6291-42ed-ba2c-2e781f074c2e tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19f6c089e7ec4ca5914d760e742d89b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329e95cbfdb9493d82941bc00dd1ccbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:38.102318 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-efc32bbe-6291-42ed-ba2c-2e781f074c2e tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] 10.222.0.55 "GET /compute/v2.1/servers/836874db-02ab-4f3d-8b87-d32c70829b1b" status: 200 len: 1319 microversion: 2.1 time: 0.146720 May 31 21:15:38.102873 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 550/1078] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:37 2022] GET /compute/v2.1/servers/836874db-02ab-4f3d-8b87-d32c70829b1b => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:15:38.742886 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-781cb9fa-67ff-41c8-99fa-8a89a5065b60 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:38.743502 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-781cb9fa-67ff-41c8-99fa-8a89a5065b60 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] [instance: 45453898-e1e4-44bb-8af5-3a1729aa2870] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:38.749938 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-781cb9fa-67ff-41c8-99fa-8a89a5065b60 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:38.750395 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-781cb9fa-67ff-41c8-99fa-8a89a5065b60 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:38.751148 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-781cb9fa-67ff-41c8-99fa-8a89a5065b60 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:38.751577 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-781cb9fa-67ff-41c8-99fa-8a89a5065b60 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:38.775835 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-4bb466d6-cb70-4618-ba64-36332f142788 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:38.776444 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-4bb466d6-cb70-4618-ba64-36332f142788 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 5cb669a7-8e63-46ac-86f6-1be4050a44ec] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:38.783025 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4bb466d6-cb70-4618-ba64-36332f142788 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:38.783477 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4bb466d6-cb70-4618-ba64-36332f142788 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:38.784250 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4bb466d6-cb70-4618-ba64-36332f142788 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:38.784690 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4bb466d6-cb70-4618-ba64-36332f142788 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:38.934743 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-781cb9fa-67ff-41c8-99fa-8a89a5065b60 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782845f8e6a440b684ae46a6ed118a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c46b1e7a32484b9c22387f2aaeb871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:38.942135 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-781cb9fa-67ff-41c8-99fa-8a89a5065b60 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] 10.222.0.55 "GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870" status: 200 len: 1261 microversion: 2.1 time: 0.203081 May 31 21:15:38.942714 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 529/1079] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:38 2022] GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870 => generated 1261 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:15:38.962057 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-4bb466d6-cb70-4618-ba64-36332f142788 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe37a6d57b4775b4e47a295c3f5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b2364f40d14160adf0220d92adaad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:38.969506 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-4bb466d6-cb70-4618-ba64-36332f142788 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec" status: 200 len: 1682 microversion: 2.1 time: 0.198044 May 31 21:15:38.970085 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 551/1080] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:38 2022] GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec => generated 1682 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:15:39.119184 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-024ad642-4365-4db7-b38c-6ea6d0365155 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:39.119708 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-024ad642-4365-4db7-b38c-6ea6d0365155 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] [instance: 836874db-02ab-4f3d-8b87-d32c70829b1b] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:39.125648 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-024ad642-4365-4db7-b38c-6ea6d0365155 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:39.126137 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-024ad642-4365-4db7-b38c-6ea6d0365155 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:39.126902 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-024ad642-4365-4db7-b38c-6ea6d0365155 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:39.127336 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-024ad642-4365-4db7-b38c-6ea6d0365155 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:39.252946 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-024ad642-4365-4db7-b38c-6ea6d0365155 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19f6c089e7ec4ca5914d760e742d89b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329e95cbfdb9493d82941bc00dd1ccbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:39.256982 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:15:39.261271 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-024ad642-4365-4db7-b38c-6ea6d0365155 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] 10.222.0.55 "GET /compute/v2.1/servers/836874db-02ab-4f3d-8b87-d32c70829b1b" status: 200 len: 1319 microversion: 2.1 time: 0.146121 May 31 21:15:39.261847 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 530/1081] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:39 2022] GET /compute/v2.1/servers/836874db-02ab-4f3d-8b87-d32c70829b1b => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:15:39.959510 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-ba8f30f9-9cb0-4b3f-a8f3-b77f148863f9 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:39.960146 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-ba8f30f9-9cb0-4b3f-a8f3-b77f148863f9 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] [instance: 45453898-e1e4-44bb-8af5-3a1729aa2870] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:39.966798 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ba8f30f9-9cb0-4b3f-a8f3-b77f148863f9 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:39.967247 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ba8f30f9-9cb0-4b3f-a8f3-b77f148863f9 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:39.968009 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ba8f30f9-9cb0-4b3f-a8f3-b77f148863f9 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:39.968448 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ba8f30f9-9cb0-4b3f-a8f3-b77f148863f9 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:39.986707 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-a523b075-8a81-4e26-9af2-616bbc289fbe tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:39.987313 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-a523b075-8a81-4e26-9af2-616bbc289fbe tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 5cb669a7-8e63-46ac-86f6-1be4050a44ec] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:39.994907 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a523b075-8a81-4e26-9af2-616bbc289fbe tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:39.995356 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a523b075-8a81-4e26-9af2-616bbc289fbe tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:39.996202 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a523b075-8a81-4e26-9af2-616bbc289fbe tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:39.996776 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a523b075-8a81-4e26-9af2-616bbc289fbe tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:40.178836 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-ba8f30f9-9cb0-4b3f-a8f3-b77f148863f9 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782845f8e6a440b684ae46a6ed118a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c46b1e7a32484b9c22387f2aaeb871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:40.182086 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-a523b075-8a81-4e26-9af2-616bbc289fbe tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe37a6d57b4775b4e47a295c3f5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b2364f40d14160adf0220d92adaad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:40.186564 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-ba8f30f9-9cb0-4b3f-a8f3-b77f148863f9 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] 10.222.0.55 "GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870" status: 200 len: 1261 microversion: 2.1 time: 0.231001 May 31 21:15:40.187152 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 552/1082] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:39 2022] GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870 => generated 1261 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:15:40.191036 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-a523b075-8a81-4e26-9af2-616bbc289fbe tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec" status: 200 len: 1682 microversion: 2.1 time: 0.208036 May 31 21:15:40.191714 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 531/1083] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:39 2022] GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec => generated 1682 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:15:40.278960 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-2ae26724-87a0-4d7f-953f-37ba79996440 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:40.279565 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-2ae26724-87a0-4d7f-953f-37ba79996440 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] [instance: 836874db-02ab-4f3d-8b87-d32c70829b1b] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:40.285499 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2ae26724-87a0-4d7f-953f-37ba79996440 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:40.285970 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2ae26724-87a0-4d7f-953f-37ba79996440 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:40.286727 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2ae26724-87a0-4d7f-953f-37ba79996440 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:40.287155 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2ae26724-87a0-4d7f-953f-37ba79996440 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:40.669662 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-2ae26724-87a0-4d7f-953f-37ba79996440 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19f6c089e7ec4ca5914d760e742d89b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329e95cbfdb9493d82941bc00dd1ccbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:40.677017 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-2ae26724-87a0-4d7f-953f-37ba79996440 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] 10.222.0.55 "GET /compute/v2.1/servers/836874db-02ab-4f3d-8b87-d32c70829b1b" status: 200 len: 1319 microversion: 2.1 time: 0.402246 May 31 21:15:40.677582 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 553/1084] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:40 2022] GET /compute/v2.1/servers/836874db-02ab-4f3d-8b87-d32c70829b1b => generated 1319 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:15:41.203038 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-6d28f3eb-a428-488b-ac55-cb82ae4e2396 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:41.203958 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-6d28f3eb-a428-488b-ac55-cb82ae4e2396 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] [instance: 45453898-e1e4-44bb-8af5-3a1729aa2870] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:41.208334 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-5851c2fe-32da-4976-b553-01d673eae206 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:41.208973 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-5851c2fe-32da-4976-b553-01d673eae206 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 5cb669a7-8e63-46ac-86f6-1be4050a44ec] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:41.211305 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-6d28f3eb-a428-488b-ac55-cb82ae4e2396 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:41.211787 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-6d28f3eb-a428-488b-ac55-cb82ae4e2396 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:41.212563 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-6d28f3eb-a428-488b-ac55-cb82ae4e2396 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:41.213003 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-6d28f3eb-a428-488b-ac55-cb82ae4e2396 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:41.215495 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5851c2fe-32da-4976-b553-01d673eae206 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:41.215947 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5851c2fe-32da-4976-b553-01d673eae206 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:41.216718 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5851c2fe-32da-4976-b553-01d673eae206 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:41.217153 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5851c2fe-32da-4976-b553-01d673eae206 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:41.235551 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell1:SELECT=100 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:15:41.410531 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-6d28f3eb-a428-488b-ac55-cb82ae4e2396 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782845f8e6a440b684ae46a6ed118a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c46b1e7a32484b9c22387f2aaeb871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:41.413484 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-5851c2fe-32da-4976-b553-01d673eae206 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe37a6d57b4775b4e47a295c3f5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b2364f40d14160adf0220d92adaad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:41.418301 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-6d28f3eb-a428-488b-ac55-cb82ae4e2396 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] 10.222.0.55 "GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870" status: 200 len: 1261 microversion: 2.1 time: 0.219316 May 31 21:15:41.418877 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 532/1085] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:41 2022] GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870 => generated 1261 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:15:41.421222 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-5851c2fe-32da-4976-b553-01d673eae206 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec" status: 200 len: 1682 microversion: 2.1 time: 0.216634 May 31 21:15:41.421784 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 554/1086] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:41 2022] GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec => generated 1682 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:15:41.694511 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-d2a4f894-4ca3-4011-a7e9-4845a9f4620e tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:41.695053 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-d2a4f894-4ca3-4011-a7e9-4845a9f4620e tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] [instance: 836874db-02ab-4f3d-8b87-d32c70829b1b] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:41.701025 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-d2a4f894-4ca3-4011-a7e9-4845a9f4620e tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:41.701481 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-d2a4f894-4ca3-4011-a7e9-4845a9f4620e tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:41.702398 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-d2a4f894-4ca3-4011-a7e9-4845a9f4620e tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:41.702837 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-d2a4f894-4ca3-4011-a7e9-4845a9f4620e tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:41.829578 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-d2a4f894-4ca3-4011-a7e9-4845a9f4620e tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19f6c089e7ec4ca5914d760e742d89b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329e95cbfdb9493d82941bc00dd1ccbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:41.836968 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-d2a4f894-4ca3-4011-a7e9-4845a9f4620e tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] 10.222.0.55 "GET /compute/v2.1/servers/836874db-02ab-4f3d-8b87-d32c70829b1b" status: 200 len: 1319 microversion: 2.1 time: 0.147092 May 31 21:15:41.837525 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 533/1087] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:41 2022] GET /compute/v2.1/servers/836874db-02ab-4f3d-8b87-d32c70829b1b => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:15:42.435050 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-7d21b653-9f4a-49a6-887e-c1dcad09f5d2 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:42.435631 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-7d21b653-9f4a-49a6-887e-c1dcad09f5d2 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] [instance: 45453898-e1e4-44bb-8af5-3a1729aa2870] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:42.438023 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-c86e63c7-430a-411c-b0d7-2c416ecbea1a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:42.438650 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-c86e63c7-430a-411c-b0d7-2c416ecbea1a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 5cb669a7-8e63-46ac-86f6-1be4050a44ec] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:42.442251 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7d21b653-9f4a-49a6-887e-c1dcad09f5d2 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:42.449660 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7d21b653-9f4a-49a6-887e-c1dcad09f5d2 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:42.449660 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7d21b653-9f4a-49a6-887e-c1dcad09f5d2 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:42.449660 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7d21b653-9f4a-49a6-887e-c1dcad09f5d2 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:42.450166 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c86e63c7-430a-411c-b0d7-2c416ecbea1a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:42.450166 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c86e63c7-430a-411c-b0d7-2c416ecbea1a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:42.450166 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c86e63c7-430a-411c-b0d7-2c416ecbea1a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:42.450166 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c86e63c7-430a-411c-b0d7-2c416ecbea1a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:42.655833 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-7d21b653-9f4a-49a6-887e-c1dcad09f5d2 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782845f8e6a440b684ae46a6ed118a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c46b1e7a32484b9c22387f2aaeb871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:42.664074 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-c86e63c7-430a-411c-b0d7-2c416ecbea1a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe37a6d57b4775b4e47a295c3f5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b2364f40d14160adf0220d92adaad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:42.674537 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-c86e63c7-430a-411c-b0d7-2c416ecbea1a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec" status: 200 len: 1682 microversion: 2.1 time: 0.239864 May 31 21:15:42.676730 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-7d21b653-9f4a-49a6-887e-c1dcad09f5d2 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] 10.222.0.55 "GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870" status: 200 len: 1261 microversion: 2.1 time: 0.245188 May 31 21:15:42.677236 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 555/1088] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:42 2022] GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870 => generated 1261 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:15:42.677384 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 534/1089] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:42 2022] GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec => generated 1682 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:15:42.854630 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-c61cf951-1ef7-4bf8-bb1b-9686a0e57a8a tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:42.855244 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-c61cf951-1ef7-4bf8-bb1b-9686a0e57a8a tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] [instance: 836874db-02ab-4f3d-8b87-d32c70829b1b] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:42.862200 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c61cf951-1ef7-4bf8-bb1b-9686a0e57a8a tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:42.862649 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c61cf951-1ef7-4bf8-bb1b-9686a0e57a8a tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:42.863425 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c61cf951-1ef7-4bf8-bb1b-9686a0e57a8a tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:42.863854 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c61cf951-1ef7-4bf8-bb1b-9686a0e57a8a tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:42.998399 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-c61cf951-1ef7-4bf8-bb1b-9686a0e57a8a tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19f6c089e7ec4ca5914d760e742d89b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329e95cbfdb9493d82941bc00dd1ccbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:43.006289 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-c61cf951-1ef7-4bf8-bb1b-9686a0e57a8a tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] 10.222.0.55 "GET /compute/v2.1/servers/836874db-02ab-4f3d-8b87-d32c70829b1b" status: 200 len: 1319 microversion: 2.1 time: 0.156008 May 31 21:15:43.006988 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 556/1090] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:42 2022] GET /compute/v2.1/servers/836874db-02ab-4f3d-8b87-d32c70829b1b => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:15:43.459923 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [req-1052617b-42ee-4f52-a62d-1a3f9e54ce73 req-b345b310-93ed-4750-8dae-8b97e45b16df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cb669a7-8e63-46ac-86f6-1be4050a44ec", "name": "network-vif-deleted", "tag": "e802cc62-ebe6-41ff-a0a9-e0f9038c9831"}]} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:15:43.468521 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-1052617b-42ee-4f52-a62d-1a3f9e54ce73 req-b345b310-93ed-4750-8dae-8b97e45b16df service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:43.468962 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-1052617b-42ee-4f52-a62d-1a3f9e54ce73 req-b345b310-93ed-4750-8dae-8b97e45b16df service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:43.480170 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.compute.server_external_events [req-1052617b-42ee-4f52-a62d-1a3f9e54ce73 req-b345b310-93ed-4750-8dae-8b97e45b16df service nova] Creating event network-vif-deleted:e802cc62-ebe6-41ff-a0a9-e0f9038c9831 for instance 5cb669a7-8e63-46ac-86f6-1be4050a44ec on hv-cinder-83979 May 31 21:15:43.485212 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [req-1052617b-42ee-4f52-a62d-1a3f9e54ce73 req-b345b310-93ed-4750-8dae-8b97e45b16df service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029503 May 31 21:15:43.485846 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 535/1091] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:15:43.692989 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-18d02b19-3845-4097-aecb-8b011f1b40e4 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:43.693797 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-18d02b19-3845-4097-aecb-8b011f1b40e4 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] [instance: 45453898-e1e4-44bb-8af5-3a1729aa2870] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:43.700432 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-84262c44-0d0f-4151-b3da-34c1c7814010 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:43.700822 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-18d02b19-3845-4097-aecb-8b011f1b40e4 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:43.701106 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-84262c44-0d0f-4151-b3da-34c1c7814010 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 5cb669a7-8e63-46ac-86f6-1be4050a44ec] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:43.701280 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-18d02b19-3845-4097-aecb-8b011f1b40e4 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:43.702115 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-18d02b19-3845-4097-aecb-8b011f1b40e4 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:43.702554 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-18d02b19-3845-4097-aecb-8b011f1b40e4 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:43.709963 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-84262c44-0d0f-4151-b3da-34c1c7814010 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:43.710153 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-84262c44-0d0f-4151-b3da-34c1c7814010 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:43.710871 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-84262c44-0d0f-4151-b3da-34c1c7814010 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:43.711311 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-84262c44-0d0f-4151-b3da-34c1c7814010 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:43.817844 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-84262c44-0d0f-4151-b3da-34c1c7814010 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe37a6d57b4775b4e47a295c3f5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b2364f40d14160adf0220d92adaad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:43.826118 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-84262c44-0d0f-4151-b3da-34c1c7814010 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec" status: 200 len: 1326 microversion: 2.1 time: 0.129948 May 31 21:15:43.826703 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 536/1092] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:43 2022] GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec => generated 1326 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:15:43.895509 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-18d02b19-3845-4097-aecb-8b011f1b40e4 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782845f8e6a440b684ae46a6ed118a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c46b1e7a32484b9c22387f2aaeb871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:43.906020 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-18d02b19-3845-4097-aecb-8b011f1b40e4 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] 10.222.0.55 "GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870" status: 200 len: 1261 microversion: 2.1 time: 0.216957 May 31 21:15:43.906918 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 557/1093] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:43 2022] GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870 => generated 1261 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:15:44.024811 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-90a6db78-4860-481e-8d45-3effb66f0cdb tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:44.025548 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-90a6db78-4860-481e-8d45-3effb66f0cdb tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] [instance: 836874db-02ab-4f3d-8b87-d32c70829b1b] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:44.035602 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-90a6db78-4860-481e-8d45-3effb66f0cdb tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:44.036202 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-90a6db78-4860-481e-8d45-3effb66f0cdb tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:44.038410 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-90a6db78-4860-481e-8d45-3effb66f0cdb tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:44.039576 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-90a6db78-4860-481e-8d45-3effb66f0cdb tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:44.226828 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [req-60ef5784-4bb1-49fb-aa62-64c8d1f3fd65 req-9903f3d5-5e54-41ce-ba86-15864a3be4d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "836874db-02ab-4f3d-8b87-d32c70829b1b", "name": "network-vif-plugged", "status": "completed", "tag": "43ac5025-cbec-4c3e-a75a-05a41cfb775f"}]} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:15:44.232074 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-90a6db78-4860-481e-8d45-3effb66f0cdb tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19f6c089e7ec4ca5914d760e742d89b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329e95cbfdb9493d82941bc00dd1ccbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:44.236509 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-60ef5784-4bb1-49fb-aa62-64c8d1f3fd65 req-9903f3d5-5e54-41ce-ba86-15864a3be4d5 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:44.236944 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-60ef5784-4bb1-49fb-aa62-64c8d1f3fd65 req-9903f3d5-5e54-41ce-ba86-15864a3be4d5 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:44.247420 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-90a6db78-4860-481e-8d45-3effb66f0cdb tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] 10.222.0.55 "GET /compute/v2.1/servers/836874db-02ab-4f3d-8b87-d32c70829b1b" status: 200 len: 1319 microversion: 2.1 time: 0.227293 May 31 21:15:44.254625 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.compute.server_external_events [req-60ef5784-4bb1-49fb-aa62-64c8d1f3fd65 req-9903f3d5-5e54-41ce-ba86-15864a3be4d5 service nova] Creating event network-vif-plugged:43ac5025-cbec-4c3e-a75a-05a41cfb775f for instance 836874db-02ab-4f3d-8b87-d32c70829b1b on hv-cinder-83979 May 31 21:15:44.256827 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 537/1094] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:44 2022] GET /compute/v2.1/servers/836874db-02ab-4f3d-8b87-d32c70829b1b => generated 1319 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:15:44.259819 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [req-60ef5784-4bb1-49fb-aa62-64c8d1f3fd65 req-9903f3d5-5e54-41ce-ba86-15864a3be4d5 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037515 May 31 21:15:44.260412 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 558/1095] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 21:15:44.843862 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-02d6838f-6747-48ae-89d4-684e9a6b39d4 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:44.846633 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-02d6838f-6747-48ae-89d4-684e9a6b39d4 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 5cb669a7-8e63-46ac-86f6-1be4050a44ec] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:44.851569 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-02d6838f-6747-48ae-89d4-684e9a6b39d4 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:44.852026 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-02d6838f-6747-48ae-89d4-684e9a6b39d4 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:44.852799 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-02d6838f-6747-48ae-89d4-684e9a6b39d4 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:44.853239 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-02d6838f-6747-48ae-89d4-684e9a6b39d4 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:44.866674 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.wsgi [None req-02d6838f-6747-48ae-89d4-684e9a6b39d4 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] HTTP exception thrown: Instance 5cb669a7-8e63-46ac-86f6-1be4050a44ec could not be found. May 31 21:15:44.868366 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-02d6838f-6747-48ae-89d4-684e9a6b39d4 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Request method failure captured: May 31 21:15:44.868366 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: request: GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec HTTP/1.1 May 31 21:15:44.868366 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Accept: application/json May 31 21:15:44.868366 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Accept-Encoding: identity May 31 21:15:44.868366 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Connection: close May 31 21:15:44.868366 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Content-Length: 0 May 31 21:15:44.868366 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Content-Type: application/json May 31 21:15:44.868366 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Host: 10.222.0.55 May 31 21:15:44.868366 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Openstack-System-Scope: None May 31 21:15:44.868366 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: User-Agent: python-urllib3/1.26.9 May 31 21:15:44.868366 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Auth-Token: gAAAAABiloR6qg65df265xnXkf0TY6yHSXRv8NS86FmUnFNzjk_pCIOLgrgfJbkxmZYFC66OdFLRA4PHOQ2UiyK6Br4eaixrZ-5NlYmO2AXCMbb_Qo66xtWpyddhdAMGxddxV67OHhRmLW9fy2wijnAPzU9Ur_Oi62eu23Z9lUdWg-uvkw7ldZA May 31 21:15:44.868366 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Domain-Id: None May 31 21:15:44.868366 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Domain-Name: None May 31 21:15:44.868366 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Identity-Status: Confirmed May 31 21:15:44.868366 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Is-Admin-Project: True May 31 21:15:44.868366 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Domain-Id: default May 31 21:15:44.868366 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Domain-Name: Default May 31 21:15:44.868366 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Id: 69b2364f40d14160adf0220d92adaad7 May 31 21:15:44.868366 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Name: tempest-AttachVolumeNegativeTest-14232740 May 31 21:15:44.868366 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Role: member,reader May 31 21:15:44.868366 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Roles: member,reader May 31 21:15:44.875451 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/69b2364f40d14160adf0220d92adaad7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/69b2364f40d14160adf0220d92adaad7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_69b2364f40d14160adf0220d92adaad7", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/69b2364f40d14160adf0220d92adaad7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] May 31 21:15:44.875451 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant: tempest-AttachVolumeNegativeTest-14232740 May 31 21:15:44.875451 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant-Id: 69b2364f40d14160adf0220d92adaad7 May 31 21:15:44.875451 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-14232740 May 31 21:15:44.875451 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User: tempest-AttachVolumeNegativeTest-14232740-project May 31 21:15:44.875451 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Domain-Id: default May 31 21:15:44.875451 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Domain-Name: Default May 31 21:15:44.875451 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Id: 8efe37a6d57b4775b4e47a295c3f5eee May 31 21:15:44.875451 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Name: tempest-AttachVolumeNegativeTest-14232740-project May 31 21:15:44.875451 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: method: > May 31 21:15:44.875451 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: exception: Instance 5cb669a7-8e63-46ac-86f6-1be4050a44ec could not be found. May 31 21:15:44.875451 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: action_args: {'id': '5cb669a7-8e63-46ac-86f6-1be4050a44ec'} May 31 21:15:44.876421 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 21:15:44.876421 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:15:44.876421 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 21:15:44.876421 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 21:15:44.876421 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 21:15:44.876421 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 21:15:44.876421 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 21:15:44.876421 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 21:15:44.876421 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 21:15:44.876421 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 21:15:44.876421 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cb669a7-8e63-46ac-86f6-1be4050a44ec could not be found. May 31 21:15:44.876421 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:15:44.876421 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:15:44.876421 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:15:44.876421 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:15:44.876421 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:15:44.876421 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:15:44.876421 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 21:15:44.876421 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 21:15:44.876421 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 21:15:44.877960 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 21:15:44.877960 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 21:15:44.877960 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 21:15:44.877960 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 21:15:44.877960 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 21:15:44.877960 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 21:15:44.877960 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 21:15:44.877960 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cb669a7-8e63-46ac-86f6-1be4050a44ec could not be found. May 31 21:15:44.877960 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:15:44.877960 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:15:44.877960 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:15:44.877960 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:15:44.877960 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:15:44.877960 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:15:44.877960 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 21:15:44.877960 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 21:15:44.877960 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cb669a7-8e63-46ac-86f6-1be4050a44ec could not be found. May 31 21:15:44.877960 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:15:44.879306 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-02d6838f-6747-48ae-89d4-684e9a6b39d4 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Returning 404 to user: Instance 5cb669a7-8e63-46ac-86f6-1be4050a44ec could not be found. {{(pid=118185) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 21:15:44.879306 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-02d6838f-6747-48ae-89d4-684e9a6b39d4 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec" status: 404 len: 111 microversion: 2.1 time: 0.029889 May 31 21:15:44.879306 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 538/1096] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:44 2022] GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 21:15:44.884588 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-74eaecb8-8e9e-44e8-bb38-c83a3e951870 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '.version_select at 0x7fe7c0ae4280>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:44.897516 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:15:44.923527 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-5f223023-41af-47e8-9fcf-25d3fec02171 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:44.924141 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-5f223023-41af-47e8-9fcf-25d3fec02171 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] [instance: 45453898-e1e4-44bb-8af5-3a1729aa2870] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:44.930124 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-5f223023-41af-47e8-9fcf-25d3fec02171 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:44.930579 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-5f223023-41af-47e8-9fcf-25d3fec02171 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:44.931350 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-5f223023-41af-47e8-9fcf-25d3fec02171 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:44.931788 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-5f223023-41af-47e8-9fcf-25d3fec02171 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:44.982693 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-74eaecb8-8e9e-44e8-bb38-c83a3e951870 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-193533202" status: 202 len: 0 microversion: 2.1 time: 0.107605 May 31 21:15:44.983373 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 559/1097] 10.222.0.55 () {58 vars in 1217 bytes} [Tue May 31 21:15:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-193533202 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 21:15:45.066549 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-5f223023-41af-47e8-9fcf-25d3fec02171 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782845f8e6a440b684ae46a6ed118a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c46b1e7a32484b9c22387f2aaeb871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:45.074999 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-5f223023-41af-47e8-9fcf-25d3fec02171 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] 10.222.0.55 "GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870" status: 200 len: 1261 microversion: 2.1 time: 0.155233 May 31 21:15:45.075575 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 539/1098] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:44 2022] GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870 => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:15:45.264347 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-4f78240f-48e8-448f-abe9-188fb2aa1796 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:45.265084 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-4f78240f-48e8-448f-abe9-188fb2aa1796 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] [instance: 836874db-02ab-4f3d-8b87-d32c70829b1b] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:45.272567 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4f78240f-48e8-448f-abe9-188fb2aa1796 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:45.273019 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4f78240f-48e8-448f-abe9-188fb2aa1796 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:45.275015 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4f78240f-48e8-448f-abe9-188fb2aa1796 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:45.275494 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4f78240f-48e8-448f-abe9-188fb2aa1796 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:45.484052 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-4f78240f-48e8-448f-abe9-188fb2aa1796 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19f6c089e7ec4ca5914d760e742d89b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329e95cbfdb9493d82941bc00dd1ccbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:45.492070 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-4f78240f-48e8-448f-abe9-188fb2aa1796 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] 10.222.0.55 "GET /compute/v2.1/servers/836874db-02ab-4f3d-8b87-d32c70829b1b" status: 200 len: 1319 microversion: 2.1 time: 0.231662 May 31 21:15:45.492648 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 560/1099] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:45 2022] GET /compute/v2.1/servers/836874db-02ab-4f3d-8b87-d32c70829b1b => generated 1319 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:15:45.818310 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-74c51526-663c-4ba5-a1db-d7c74966cd66 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Action: 'create', calling method: .version_select at 0x7fe7c0fef040>, body: {"keypair": {"name": "tempest-keypair-753023604", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOAQnL8AAivlfvt4r9IwuqSlAV9+7ymY4Eq6z7Tr3a8oTMuSfR1c4IDLt4MnPxRbGJMkrBIxLadZZOkVqcp8PzR6ztjgB16VNxOz5kDZFX8MKSHU1TjxpGB+vl7SePSHg=="}} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:15:45.832391 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.quota [None req-74c51526-663c-4ba5-a1db-d7c74966cd66 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Getting quotas for project 69b2364f40d14160adf0220d92adaad7. Resources: {'key_pairs'} {{(pid=118185) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 21:15:45.836161 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.quota [None req-74c51526-663c-4ba5-a1db-d7c74966cd66 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Getting quotas for user 8efe37a6d57b4775b4e47a295c3f5eee and project 69b2364f40d14160adf0220d92adaad7. Resources: {'key_pairs'} {{(pid=118185) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 21:15:45.949610 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-74c51526-663c-4ba5-a1db-d7c74966cd66 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.135140 May 31 21:15:45.950248 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 540/1100] 10.222.0.55 () {60 vars in 1158 bytes} [Tue May 31 21:15:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:15:46.091986 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-9665bf14-9a2c-48f4-8c06-f247feab16c3 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:46.092607 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-9665bf14-9a2c-48f4-8c06-f247feab16c3 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] [instance: 45453898-e1e4-44bb-8af5-3a1729aa2870] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:46.099578 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-9665bf14-9a2c-48f4-8c06-f247feab16c3 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:46.100733 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-9665bf14-9a2c-48f4-8c06-f247feab16c3 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:46.101516 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-9665bf14-9a2c-48f4-8c06-f247feab16c3 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:46.101992 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-9665bf14-9a2c-48f4-8c06-f247feab16c3 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:46.275207 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-9665bf14-9a2c-48f4-8c06-f247feab16c3 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782845f8e6a440b684ae46a6ed118a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c46b1e7a32484b9c22387f2aaeb871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:46.275818 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [req-26f34ab7-f826-423c-88d1-c806bd186b7a req-99d0c24d-1e23-4417-bb79-4e85bb2aef5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45453898-e1e4-44bb-8af5-3a1729aa2870", "name": "network-vif-plugged", "status": "completed", "tag": "6278ba73-77b2-4be4-a1a0-b7b239769dc3"}]} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:15:46.281888 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-9665bf14-9a2c-48f4-8c06-f247feab16c3 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] 10.222.0.55 "GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870" status: 200 len: 1261 microversion: 2.1 time: 0.193923 May 31 21:15:46.282541 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 561/1101] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:46 2022] GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870 => generated 1261 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:15:46.284140 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-26f34ab7-f826-423c-88d1-c806bd186b7a req-99d0c24d-1e23-4417-bb79-4e85bb2aef5f service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:46.284616 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-26f34ab7-f826-423c-88d1-c806bd186b7a req-99d0c24d-1e23-4417-bb79-4e85bb2aef5f service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:46.305326 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.compute.server_external_events [req-26f34ab7-f826-423c-88d1-c806bd186b7a req-99d0c24d-1e23-4417-bb79-4e85bb2aef5f service nova] Creating event network-vif-plugged:6278ba73-77b2-4be4-a1a0-b7b239769dc3 for instance 45453898-e1e4-44bb-8af5-3a1729aa2870 on hv-cinder-83979 May 31 21:15:46.310200 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [req-26f34ab7-f826-423c-88d1-c806bd186b7a req-99d0c24d-1e23-4417-bb79-4e85bb2aef5f service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038634 May 31 21:15:46.310815 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 541/1102] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:15:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 21:15:46.509393 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-e3afc83c-1574-4a2a-a18b-939fd9dae85e tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:46.509948 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-e3afc83c-1574-4a2a-a18b-939fd9dae85e tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] [instance: 836874db-02ab-4f3d-8b87-d32c70829b1b] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:46.516234 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e3afc83c-1574-4a2a-a18b-939fd9dae85e tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:46.518869 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e3afc83c-1574-4a2a-a18b-939fd9dae85e tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:46.518869 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e3afc83c-1574-4a2a-a18b-939fd9dae85e tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:46.518869 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e3afc83c-1574-4a2a-a18b-939fd9dae85e tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:46.674197 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-e3afc83c-1574-4a2a-a18b-939fd9dae85e tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19f6c089e7ec4ca5914d760e742d89b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329e95cbfdb9493d82941bc00dd1ccbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:46.682364 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-e3afc83c-1574-4a2a-a18b-939fd9dae85e tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] 10.222.0.55 "GET /compute/v2.1/servers/836874db-02ab-4f3d-8b87-d32c70829b1b" status: 200 len: 1319 microversion: 2.1 time: 0.177410 May 31 21:15:46.685502 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 562/1103] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:46 2022] GET /compute/v2.1/servers/836874db-02ab-4f3d-8b87-d32c70829b1b => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:15:47.301765 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-9437e484-d6ac-4f6e-ade4-fb2a484e3a6b tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:47.302410 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-9437e484-d6ac-4f6e-ade4-fb2a484e3a6b tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] [instance: 45453898-e1e4-44bb-8af5-3a1729aa2870] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:47.308691 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9437e484-d6ac-4f6e-ade4-fb2a484e3a6b tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:47.309185 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9437e484-d6ac-4f6e-ade4-fb2a484e3a6b tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:47.310162 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9437e484-d6ac-4f6e-ade4-fb2a484e3a6b tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:47.310598 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9437e484-d6ac-4f6e-ade4-fb2a484e3a6b tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:47.450070 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-9437e484-d6ac-4f6e-ade4-fb2a484e3a6b tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782845f8e6a440b684ae46a6ed118a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c46b1e7a32484b9c22387f2aaeb871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:47.457960 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-9437e484-d6ac-4f6e-ade4-fb2a484e3a6b tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] 10.222.0.55 "GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870" status: 200 len: 1261 microversion: 2.1 time: 0.161115 May 31 21:15:47.463693 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 542/1104] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:47 2022] GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870 => generated 1261 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:15:47.700832 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-93268b01-a709-4295-9981-e30c712d7a56 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:47.701444 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-93268b01-a709-4295-9981-e30c712d7a56 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] [instance: 836874db-02ab-4f3d-8b87-d32c70829b1b] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:47.708580 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-93268b01-a709-4295-9981-e30c712d7a56 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:47.709024 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-93268b01-a709-4295-9981-e30c712d7a56 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:47.710026 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-93268b01-a709-4295-9981-e30c712d7a56 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:47.710464 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-93268b01-a709-4295-9981-e30c712d7a56 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:47.843901 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-93268b01-a709-4295-9981-e30c712d7a56 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19f6c089e7ec4ca5914d760e742d89b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329e95cbfdb9493d82941bc00dd1ccbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:47.852151 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-93268b01-a709-4295-9981-e30c712d7a56 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] 10.222.0.55 "GET /compute/v2.1/servers/836874db-02ab-4f3d-8b87-d32c70829b1b" status: 200 len: 1508 microversion: 2.1 time: 0.155165 May 31 21:15:47.852838 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 563/1105] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:47 2022] GET /compute/v2.1/servers/836874db-02ab-4f3d-8b87-d32c70829b1b => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:15:48.395538 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-aabdfa23-e45f-4296-a8b3-f78ec3a67890 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1856621927", "imageRef": "21b89996-9e87-489d-8891-305f6c3d905a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f9f27def-cef7-45b6-9a7b-b0c954078818"}], "security_groups": [{"name": "tempest-securitygroup--1336561493"}], "key_name": "tempest-keypair-753023604", "user_data": "}} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:15:48.475208 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-b92d6854-f29e-46b5-8e50-e2e50c5fa883 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:48.476505 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-b92d6854-f29e-46b5-8e50-e2e50c5fa883 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] [instance: 45453898-e1e4-44bb-8af5-3a1729aa2870] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:48.482562 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b92d6854-f29e-46b5-8e50-e2e50c5fa883 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:48.482999 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b92d6854-f29e-46b5-8e50-e2e50c5fa883 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:48.483771 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b92d6854-f29e-46b5-8e50-e2e50c5fa883 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:48.484208 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b92d6854-f29e-46b5-8e50-e2e50c5fa883 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:48.501055 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.network.neutron [None req-aabdfa23-e45f-4296-a8b3-f78ec3a67890 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] validate_networks() for [('f9f27def-cef7-45b6-9a7b-b0c954078818', None, None, None, None, None)] {{(pid=118185) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 21:15:48.721826 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-b92d6854-f29e-46b5-8e50-e2e50c5fa883 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782845f8e6a440b684ae46a6ed118a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c46b1e7a32484b9c22387f2aaeb871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:48.729829 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-b92d6854-f29e-46b5-8e50-e2e50c5fa883 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] 10.222.0.55 "GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870" status: 200 len: 1261 microversion: 2.1 time: 0.258509 May 31 21:15:48.730442 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 564/1106] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:48 2022] GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870 => generated 1261 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:15:48.967295 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.virt.hardware [None req-aabdfa23-e45f-4296-a8b3-f78ec3a67890 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Flavor limits 0:0:0 {{(pid=118185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 21:15:48.967742 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.virt.hardware [None req-aabdfa23-e45f-4296-a8b3-f78ec3a67890 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Image limits 0:0:0 {{(pid=118185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 21:15:48.968212 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.virt.hardware [None req-aabdfa23-e45f-4296-a8b3-f78ec3a67890 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Flavor pref 0:0:0 {{(pid=118185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 21:15:48.968625 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.virt.hardware [None req-aabdfa23-e45f-4296-a8b3-f78ec3a67890 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Image pref 0:0:0 {{(pid=118185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 21:15:48.969032 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.virt.hardware [None req-aabdfa23-e45f-4296-a8b3-f78ec3a67890 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 21:15:48.977667 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-aabdfa23-e45f-4296-a8b3-f78ec3a67890 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:48.978171 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-aabdfa23-e45f-4296-a8b3-f78ec3a67890 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:48.978937 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-aabdfa23-e45f-4296-a8b3-f78ec3a67890 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:48.979367 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-aabdfa23-e45f-4296-a8b3-f78ec3a67890 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:48.996802 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.quota [None req-aabdfa23-e45f-4296-a8b3-f78ec3a67890 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Getting quotas for project 69b2364f40d14160adf0220d92adaad7. Resources: {'ram', 'cores', 'instances'} {{(pid=118185) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 21:15:49.000698 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.quota [None req-aabdfa23-e45f-4296-a8b3-f78ec3a67890 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Getting quotas for user 8efe37a6d57b4775b4e47a295c3f5eee and project 69b2364f40d14160adf0220d92adaad7. Resources: {'ram', 'cores', 'instances'} {{(pid=118185) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 21:15:49.012984 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-aabdfa23-e45f-4296-a8b3-f78ec3a67890 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Going to run 1 instances... {{(pid=118185) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 21:15:49.020916 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-aabdfa23-e45f-4296-a8b3-f78ec3a67890 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: cd8f2486-d4cf-40d9-9a07-d12933c0923b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='21b89996-9e87-489d-8891-305f6c3d905a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118185) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 21:15:49.161703 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-aabdfa23-e45f-4296-a8b3-f78ec3a67890 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.770419 May 31 21:15:49.165947 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 543/1107] 10.222.0.55 () {60 vars in 1146 bytes} [Tue May 31 21:15:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 31 21:15:49.172818 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-4176914d-1469-4563-854f-8f9428a1458f tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:49.173537 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-4176914d-1469-4563-854f-8f9428a1458f tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: cd8f2486-d4cf-40d9-9a07-d12933c0923b] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:49.228533 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-4176914d-1469-4563-854f-8f9428a1458f tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe37a6d57b4775b4e47a295c3f5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b2364f40d14160adf0220d92adaad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:49.251375 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-4176914d-1469-4563-854f-8f9428a1458f tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/cd8f2486-d4cf-40d9-9a07-d12933c0923b" status: 200 len: 1241 microversion: 2.1 time: 0.066426 May 31 21:15:49.251375 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 565/1108] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:49 2022] GET /compute/v2.1/servers/cd8f2486-d4cf-40d9-9a07-d12933c0923b => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:15:49.746323 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-79430099-b1f6-4515-9a89-7774804cac4d tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:49.746931 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-79430099-b1f6-4515-9a89-7774804cac4d tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] [instance: 45453898-e1e4-44bb-8af5-3a1729aa2870] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:49.755306 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-79430099-b1f6-4515-9a89-7774804cac4d tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:49.755757 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-79430099-b1f6-4515-9a89-7774804cac4d tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:49.756555 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-79430099-b1f6-4515-9a89-7774804cac4d tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:49.756986 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-79430099-b1f6-4515-9a89-7774804cac4d tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:49.891494 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-79430099-b1f6-4515-9a89-7774804cac4d tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782845f8e6a440b684ae46a6ed118a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c46b1e7a32484b9c22387f2aaeb871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:49.899525 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-79430099-b1f6-4515-9a89-7774804cac4d tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] 10.222.0.55 "GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870" status: 200 len: 1446 microversion: 2.1 time: 0.157647 May 31 21:15:49.907982 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 544/1109] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:49 2022] GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870 => generated 1446 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:15:49.916409 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-2dd51ae8-a1e5-45e0-9d3e-710b1f3b3c22 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:49.917009 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-2dd51ae8-a1e5-45e0-9d3e-710b1f3b3c22 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] [instance: 45453898-e1e4-44bb-8af5-3a1729aa2870] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:49.924490 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2dd51ae8-a1e5-45e0-9d3e-710b1f3b3c22 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:49.924933 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2dd51ae8-a1e5-45e0-9d3e-710b1f3b3c22 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:49.925689 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2dd51ae8-a1e5-45e0-9d3e-710b1f3b3c22 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:49.926150 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2dd51ae8-a1e5-45e0-9d3e-710b1f3b3c22 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:50.066296 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-2dd51ae8-a1e5-45e0-9d3e-710b1f3b3c22 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782845f8e6a440b684ae46a6ed118a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c46b1e7a32484b9c22387f2aaeb871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:50.076144 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-2dd51ae8-a1e5-45e0-9d3e-710b1f3b3c22 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] 10.222.0.55 "GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870" status: 200 len: 1446 microversion: 2.1 time: 0.164022 May 31 21:15:50.076836 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 566/1110] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:49 2022] GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870 => generated 1446 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:15:50.258795 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-20ccac73-bbef-43f0-8613-599bc9335a08 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:50.258795 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-20ccac73-bbef-43f0-8613-599bc9335a08 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: cd8f2486-d4cf-40d9-9a07-d12933c0923b] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:50.271427 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-20ccac73-bbef-43f0-8613-599bc9335a08 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:50.272272 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-20ccac73-bbef-43f0-8613-599bc9335a08 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:50.274266 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-20ccac73-bbef-43f0-8613-599bc9335a08 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:50.275079 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-20ccac73-bbef-43f0-8613-599bc9335a08 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:50.338103 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-20ccac73-bbef-43f0-8613-599bc9335a08 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe37a6d57b4775b4e47a295c3f5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b2364f40d14160adf0220d92adaad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:50.346702 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-20ccac73-bbef-43f0-8613-599bc9335a08 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/cd8f2486-d4cf-40d9-9a07-d12933c0923b" status: 200 len: 1245 microversion: 2.1 time: 0.097912 May 31 21:15:50.355613 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 545/1111] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:50 2022] GET /compute/v2.1/servers/cd8f2486-d4cf-40d9-9a07-d12933c0923b => generated 1245 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:15:51.363869 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-046ff19a-829a-4b76-99c0-cc14efa68633 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:51.364798 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-046ff19a-829a-4b76-99c0-cc14efa68633 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: cd8f2486-d4cf-40d9-9a07-d12933c0923b] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:51.372072 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-046ff19a-829a-4b76-99c0-cc14efa68633 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:51.372625 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-046ff19a-829a-4b76-99c0-cc14efa68633 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:51.373630 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-046ff19a-829a-4b76-99c0-cc14efa68633 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:51.374854 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-046ff19a-829a-4b76-99c0-cc14efa68633 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:51.446515 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-046ff19a-829a-4b76-99c0-cc14efa68633 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe37a6d57b4775b4e47a295c3f5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b2364f40d14160adf0220d92adaad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:51.455089 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-046ff19a-829a-4b76-99c0-cc14efa68633 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/cd8f2486-d4cf-40d9-9a07-d12933c0923b" status: 200 len: 1311 microversion: 2.1 time: 0.095218 May 31 21:15:51.455659 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 567/1112] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:51 2022] GET /compute/v2.1/servers/cd8f2486-d4cf-40d9-9a07-d12933c0923b => generated 1311 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:15:52.472924 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-dd6d2517-0196-4106-bd77-9826b1c12c0a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:52.473489 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-dd6d2517-0196-4106-bd77-9826b1c12c0a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: cd8f2486-d4cf-40d9-9a07-d12933c0923b] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:52.480766 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-dd6d2517-0196-4106-bd77-9826b1c12c0a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:52.481212 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-dd6d2517-0196-4106-bd77-9826b1c12c0a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:52.482023 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-dd6d2517-0196-4106-bd77-9826b1c12c0a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:52.482460 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-dd6d2517-0196-4106-bd77-9826b1c12c0a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:52.655588 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-dd6d2517-0196-4106-bd77-9826b1c12c0a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe37a6d57b4775b4e47a295c3f5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b2364f40d14160adf0220d92adaad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:52.670260 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-dd6d2517-0196-4106-bd77-9826b1c12c0a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/cd8f2486-d4cf-40d9-9a07-d12933c0923b" status: 200 len: 1367 microversion: 2.1 time: 0.199972 May 31 21:15:52.671452 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 546/1113] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:52 2022] GET /compute/v2.1/servers/cd8f2486-d4cf-40d9-9a07-d12933c0923b => generated 1367 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:15:52.798174 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [req-06ca5848-de52-44b0-880c-6d080a9ce0c0 req-65908e2e-decc-4bec-9ae7-bbb9742d0051 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45453898-e1e4-44bb-8af5-3a1729aa2870", "tag": "6278ba73-77b2-4be4-a1a0-b7b239769dc3"}]} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:15:52.807602 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-06ca5848-de52-44b0-880c-6d080a9ce0c0 req-65908e2e-decc-4bec-9ae7-bbb9742d0051 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:52.808054 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-06ca5848-de52-44b0-880c-6d080a9ce0c0 req-65908e2e-decc-4bec-9ae7-bbb9742d0051 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:52.825833 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.compute.server_external_events [req-06ca5848-de52-44b0-880c-6d080a9ce0c0 req-65908e2e-decc-4bec-9ae7-bbb9742d0051 service nova] Creating event network-changed:6278ba73-77b2-4be4-a1a0-b7b239769dc3 for instance 45453898-e1e4-44bb-8af5-3a1729aa2870 on hv-cinder-83979 May 31 21:15:52.826229 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [req-06ca5848-de52-44b0-880c-6d080a9ce0c0 req-65908e2e-decc-4bec-9ae7-bbb9742d0051 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035917 May 31 21:15:52.826983 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 568/1114] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:15:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 21:15:53.689055 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-7040a72b-c33e-4a80-8bb0-a9bdd534ac03 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:53.689783 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-7040a72b-c33e-4a80-8bb0-a9bdd534ac03 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: cd8f2486-d4cf-40d9-9a07-d12933c0923b] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:53.696839 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-7040a72b-c33e-4a80-8bb0-a9bdd534ac03 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:53.697663 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-7040a72b-c33e-4a80-8bb0-a9bdd534ac03 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:53.698513 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-7040a72b-c33e-4a80-8bb0-a9bdd534ac03 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:53.699117 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-7040a72b-c33e-4a80-8bb0-a9bdd534ac03 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:53.867596 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-7040a72b-c33e-4a80-8bb0-a9bdd534ac03 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe37a6d57b4775b4e47a295c3f5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b2364f40d14160adf0220d92adaad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:53.873311 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-7040a72b-c33e-4a80-8bb0-a9bdd534ac03 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/cd8f2486-d4cf-40d9-9a07-d12933c0923b" status: 200 len: 1367 microversion: 2.1 time: 0.189226 May 31 21:15:53.874751 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 547/1115] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:53 2022] GET /compute/v2.1/servers/cd8f2486-d4cf-40d9-9a07-d12933c0923b => generated 1367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:15:54.843622 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [req-45109df1-5106-4a1f-a308-826a936ea6cf req-be0ae243-9304-443c-a601-c6749d5ac998 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd8f2486-d4cf-40d9-9a07-d12933c0923b", "tag": "8d4969e6-911a-44ca-b161-644f80deb122"}]} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:15:54.853465 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-45109df1-5106-4a1f-a308-826a936ea6cf req-be0ae243-9304-443c-a601-c6749d5ac998 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:54.854049 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-45109df1-5106-4a1f-a308-826a936ea6cf req-be0ae243-9304-443c-a601-c6749d5ac998 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:54.868389 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.compute.server_external_events [req-45109df1-5106-4a1f-a308-826a936ea6cf req-be0ae243-9304-443c-a601-c6749d5ac998 service nova] Creating event network-changed:8d4969e6-911a-44ca-b161-644f80deb122 for instance cd8f2486-d4cf-40d9-9a07-d12933c0923b on hv-cinder-83979 May 31 21:15:54.872992 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [req-45109df1-5106-4a1f-a308-826a936ea6cf req-be0ae243-9304-443c-a601-c6749d5ac998 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033877 May 31 21:15:54.873722 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 569/1116] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:15:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:15:54.890028 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-54910aa9-a2da-439b-9cc8-173ff6c4e55c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:54.890668 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-54910aa9-a2da-439b-9cc8-173ff6c4e55c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: cd8f2486-d4cf-40d9-9a07-d12933c0923b] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:54.897364 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-54910aa9-a2da-439b-9cc8-173ff6c4e55c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:54.897812 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-54910aa9-a2da-439b-9cc8-173ff6c4e55c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:54.898620 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-54910aa9-a2da-439b-9cc8-173ff6c4e55c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:54.899175 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-54910aa9-a2da-439b-9cc8-173ff6c4e55c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:55.039667 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-54910aa9-a2da-439b-9cc8-173ff6c4e55c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe37a6d57b4775b4e47a295c3f5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b2364f40d14160adf0220d92adaad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:55.047074 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-54910aa9-a2da-439b-9cc8-173ff6c4e55c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/cd8f2486-d4cf-40d9-9a07-d12933c0923b" status: 200 len: 1367 microversion: 2.1 time: 0.160923 May 31 21:15:55.047634 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 548/1117] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:54 2022] GET /compute/v2.1/servers/cd8f2486-d4cf-40d9-9a07-d12933c0923b => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:15:56.064471 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-ddd7db39-e7bd-4549-8b08-5e123cb4f97a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:56.065064 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-ddd7db39-e7bd-4549-8b08-5e123cb4f97a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: cd8f2486-d4cf-40d9-9a07-d12933c0923b] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:56.072787 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ddd7db39-e7bd-4549-8b08-5e123cb4f97a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:56.073351 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ddd7db39-e7bd-4549-8b08-5e123cb4f97a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:56.074270 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ddd7db39-e7bd-4549-8b08-5e123cb4f97a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:56.074710 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ddd7db39-e7bd-4549-8b08-5e123cb4f97a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:56.218469 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-ddd7db39-e7bd-4549-8b08-5e123cb4f97a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe37a6d57b4775b4e47a295c3f5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b2364f40d14160adf0220d92adaad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:56.225990 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-ddd7db39-e7bd-4549-8b08-5e123cb4f97a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/cd8f2486-d4cf-40d9-9a07-d12933c0923b" status: 200 len: 1367 microversion: 2.1 time: 0.166481 May 31 21:15:56.226565 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 570/1118] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:56 2022] GET /compute/v2.1/servers/cd8f2486-d4cf-40d9-9a07-d12933c0923b => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:15:57.243257 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-17f7357f-4353-41ba-8e34-79a12d041509 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:57.243874 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-17f7357f-4353-41ba-8e34-79a12d041509 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: cd8f2486-d4cf-40d9-9a07-d12933c0923b] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:57.250769 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-17f7357f-4353-41ba-8e34-79a12d041509 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:57.251220 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-17f7357f-4353-41ba-8e34-79a12d041509 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:57.252002 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-17f7357f-4353-41ba-8e34-79a12d041509 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:57.252440 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-17f7357f-4353-41ba-8e34-79a12d041509 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:57.393588 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-17f7357f-4353-41ba-8e34-79a12d041509 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe37a6d57b4775b4e47a295c3f5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b2364f40d14160adf0220d92adaad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:57.414433 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-17f7357f-4353-41ba-8e34-79a12d041509 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/cd8f2486-d4cf-40d9-9a07-d12933c0923b" status: 200 len: 1367 microversion: 2.1 time: 0.174910 May 31 21:15:57.415038 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 549/1119] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:57 2022] GET /compute/v2.1/servers/cd8f2486-d4cf-40d9-9a07-d12933c0923b => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:15:58.432065 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-4a633f6a-66c6-408a-b0f5-1d92990d3ae2 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:58.432667 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-4a633f6a-66c6-408a-b0f5-1d92990d3ae2 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: cd8f2486-d4cf-40d9-9a07-d12933c0923b] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:58.439432 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4a633f6a-66c6-408a-b0f5-1d92990d3ae2 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:58.439873 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4a633f6a-66c6-408a-b0f5-1d92990d3ae2 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:58.440627 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4a633f6a-66c6-408a-b0f5-1d92990d3ae2 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:58.441057 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-4a633f6a-66c6-408a-b0f5-1d92990d3ae2 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:58.572118 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-4a633f6a-66c6-408a-b0f5-1d92990d3ae2 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe37a6d57b4775b4e47a295c3f5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b2364f40d14160adf0220d92adaad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:58.579727 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-4a633f6a-66c6-408a-b0f5-1d92990d3ae2 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/cd8f2486-d4cf-40d9-9a07-d12933c0923b" status: 200 len: 1367 microversion: 2.1 time: 0.152263 May 31 21:15:58.580284 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 571/1120] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:58 2022] GET /compute/v2.1/servers/cd8f2486-d4cf-40d9-9a07-d12933c0923b => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:15:59.596918 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-03fbcc1f-4557-47cb-9de0-4fbc1e3a1813 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:15:59.597523 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-03fbcc1f-4557-47cb-9de0-4fbc1e3a1813 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: cd8f2486-d4cf-40d9-9a07-d12933c0923b] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:15:59.599960 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell0:SELECT=2 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:15:59.600600 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell0:SELECT=10 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:15:59.605406 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-03fbcc1f-4557-47cb-9de0-4fbc1e3a1813 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:59.609562 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-03fbcc1f-4557-47cb-9de0-4fbc1e3a1813 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:59.609562 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-03fbcc1f-4557-47cb-9de0-4fbc1e3a1813 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:15:59.609562 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-03fbcc1f-4557-47cb-9de0-4fbc1e3a1813 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:15:59.743736 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-03fbcc1f-4557-47cb-9de0-4fbc1e3a1813 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe37a6d57b4775b4e47a295c3f5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b2364f40d14160adf0220d92adaad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:15:59.751653 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-03fbcc1f-4557-47cb-9de0-4fbc1e3a1813 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/cd8f2486-d4cf-40d9-9a07-d12933c0923b" status: 200 len: 1367 microversion: 2.1 time: 0.158613 May 31 21:15:59.752243 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 550/1121] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:15:59 2022] GET /compute/v2.1/servers/cd8f2486-d4cf-40d9-9a07-d12933c0923b => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:16:00.769475 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-36368448-f00a-4a5b-a2bc-50e9fb7f643a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:16:00.770027 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-36368448-f00a-4a5b-a2bc-50e9fb7f643a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: cd8f2486-d4cf-40d9-9a07-d12933c0923b] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:16:00.771962 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell0:SELECT=2 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:16:00.778151 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-36368448-f00a-4a5b-a2bc-50e9fb7f643a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:16:00.778597 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-36368448-f00a-4a5b-a2bc-50e9fb7f643a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:16:00.779427 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-36368448-f00a-4a5b-a2bc-50e9fb7f643a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:16:00.779909 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-36368448-f00a-4a5b-a2bc-50e9fb7f643a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:16:00.917050 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-36368448-f00a-4a5b-a2bc-50e9fb7f643a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe37a6d57b4775b4e47a295c3f5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b2364f40d14160adf0220d92adaad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:16:00.924727 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-36368448-f00a-4a5b-a2bc-50e9fb7f643a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/cd8f2486-d4cf-40d9-9a07-d12933c0923b" status: 200 len: 1367 microversion: 2.1 time: 0.159178 May 31 21:16:00.925293 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 572/1122] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:16:00 2022] GET /compute/v2.1/servers/cd8f2486-d4cf-40d9-9a07-d12933c0923b => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:16:01.942097 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-2089e5ea-9272-4f24-bbb6-ba41e1e06a66 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:16:01.942708 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-2089e5ea-9272-4f24-bbb6-ba41e1e06a66 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: cd8f2486-d4cf-40d9-9a07-d12933c0923b] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:16:01.949548 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-2089e5ea-9272-4f24-bbb6-ba41e1e06a66 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:16:01.950036 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-2089e5ea-9272-4f24-bbb6-ba41e1e06a66 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:16:01.950817 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-2089e5ea-9272-4f24-bbb6-ba41e1e06a66 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:16:01.951255 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-2089e5ea-9272-4f24-bbb6-ba41e1e06a66 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:16:01.955622 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell1:SELECT=100 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:16:02.087422 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-2089e5ea-9272-4f24-bbb6-ba41e1e06a66 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe37a6d57b4775b4e47a295c3f5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b2364f40d14160adf0220d92adaad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:16:02.095061 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-2089e5ea-9272-4f24-bbb6-ba41e1e06a66 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/cd8f2486-d4cf-40d9-9a07-d12933c0923b" status: 200 len: 1367 microversion: 2.1 time: 0.156852 May 31 21:16:02.095851 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 551/1123] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:16:01 2022] GET /compute/v2.1/servers/cd8f2486-d4cf-40d9-9a07-d12933c0923b => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:16:02.174557 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [req-24a6257b-604e-4bb6-bf4b-0a151cad1bc9 req-0a0a49e4-60f8-4062-8627-f7f30b55cff9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd8f2486-d4cf-40d9-9a07-d12933c0923b", "name": "network-vif-plugged", "status": "completed", "tag": "8d4969e6-911a-44ca-b161-644f80deb122"}]} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:16:02.185679 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-24a6257b-604e-4bb6-bf4b-0a151cad1bc9 req-0a0a49e4-60f8-4062-8627-f7f30b55cff9 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:16:02.186463 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-24a6257b-604e-4bb6-bf4b-0a151cad1bc9 req-0a0a49e4-60f8-4062-8627-f7f30b55cff9 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:16:02.197778 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.compute.server_external_events [req-24a6257b-604e-4bb6-bf4b-0a151cad1bc9 req-0a0a49e4-60f8-4062-8627-f7f30b55cff9 service nova] Creating event network-vif-plugged:8d4969e6-911a-44ca-b161-644f80deb122 for instance cd8f2486-d4cf-40d9-9a07-d12933c0923b on hv-cinder-83979 May 31 21:16:02.203063 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [req-24a6257b-604e-4bb6-bf4b-0a151cad1bc9 req-0a0a49e4-60f8-4062-8627-f7f30b55cff9 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032047 May 31 21:16:02.203638 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 573/1124] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:16:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 21:16:03.112068 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-616cbfdb-bd27-4e2a-9121-23d48b77c76d tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:16:03.112633 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-616cbfdb-bd27-4e2a-9121-23d48b77c76d tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: cd8f2486-d4cf-40d9-9a07-d12933c0923b] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:16:03.119406 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-616cbfdb-bd27-4e2a-9121-23d48b77c76d tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:16:03.119863 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-616cbfdb-bd27-4e2a-9121-23d48b77c76d tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:16:03.120736 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-616cbfdb-bd27-4e2a-9121-23d48b77c76d tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:16:03.121180 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-616cbfdb-bd27-4e2a-9121-23d48b77c76d tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:16:03.253047 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-616cbfdb-bd27-4e2a-9121-23d48b77c76d tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe37a6d57b4775b4e47a295c3f5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b2364f40d14160adf0220d92adaad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:16:03.261112 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-616cbfdb-bd27-4e2a-9121-23d48b77c76d tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/cd8f2486-d4cf-40d9-9a07-d12933c0923b" status: 200 len: 1367 microversion: 2.1 time: 0.153049 May 31 21:16:03.261680 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 552/1125] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:16:03 2022] GET /compute/v2.1/servers/cd8f2486-d4cf-40d9-9a07-d12933c0923b => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:16:04.280237 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-ed0438e7-05dc-4f7a-9b3c-3c7b0c853ab5 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:16:04.280934 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-ed0438e7-05dc-4f7a-9b3c-3c7b0c853ab5 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: cd8f2486-d4cf-40d9-9a07-d12933c0923b] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:16:04.287558 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ed0438e7-05dc-4f7a-9b3c-3c7b0c853ab5 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:16:04.288003 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ed0438e7-05dc-4f7a-9b3c-3c7b0c853ab5 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:16:04.288773 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ed0438e7-05dc-4f7a-9b3c-3c7b0c853ab5 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:16:04.289825 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ed0438e7-05dc-4f7a-9b3c-3c7b0c853ab5 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:16:04.431973 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-ed0438e7-05dc-4f7a-9b3c-3c7b0c853ab5 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe37a6d57b4775b4e47a295c3f5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b2364f40d14160adf0220d92adaad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:16:04.439369 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-ed0438e7-05dc-4f7a-9b3c-3c7b0c853ab5 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/cd8f2486-d4cf-40d9-9a07-d12933c0923b" status: 200 len: 1367 microversion: 2.1 time: 0.164408 May 31 21:16:04.439927 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 574/1126] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:16:04 2022] GET /compute/v2.1/servers/cd8f2486-d4cf-40d9-9a07-d12933c0923b => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:16:05.456475 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-51182af9-0dca-4b23-acf5-bdd23e1e0ff5 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:16:05.457092 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-51182af9-0dca-4b23-acf5-bdd23e1e0ff5 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: cd8f2486-d4cf-40d9-9a07-d12933c0923b] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:16:05.463642 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-51182af9-0dca-4b23-acf5-bdd23e1e0ff5 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:16:05.464105 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-51182af9-0dca-4b23-acf5-bdd23e1e0ff5 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:16:05.464890 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-51182af9-0dca-4b23-acf5-bdd23e1e0ff5 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:16:05.465334 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-51182af9-0dca-4b23-acf5-bdd23e1e0ff5 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:16:05.594415 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-51182af9-0dca-4b23-acf5-bdd23e1e0ff5 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe37a6d57b4775b4e47a295c3f5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b2364f40d14160adf0220d92adaad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:16:05.602050 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-51182af9-0dca-4b23-acf5-bdd23e1e0ff5 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/cd8f2486-d4cf-40d9-9a07-d12933c0923b" status: 200 len: 1556 microversion: 2.1 time: 0.149662 May 31 21:16:05.602624 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 553/1127] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:16:05 2022] GET /compute/v2.1/servers/cd8f2486-d4cf-40d9-9a07-d12933c0923b => generated 1556 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:16:05.626899 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-d0750724-932b-483c-a4b1-905e3788e291 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:16:05.627458 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-d0750724-932b-483c-a4b1-905e3788e291 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: cd8f2486-d4cf-40d9-9a07-d12933c0923b] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:16:05.634594 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d0750724-932b-483c-a4b1-905e3788e291 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:16:05.635039 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d0750724-932b-483c-a4b1-905e3788e291 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:16:05.635796 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d0750724-932b-483c-a4b1-905e3788e291 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:16:05.636233 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d0750724-932b-483c-a4b1-905e3788e291 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:16:05.715361 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-d0750724-932b-483c-a4b1-905e3788e291 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/cd8f2486-d4cf-40d9-9a07-d12933c0923b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092351 May 31 21:16:05.715955 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 575/1128] 10.222.0.55 () {58 vars in 1274 bytes} [Tue May 31 21:16:05 2022] GET /compute/v2.1/servers/cd8f2486-d4cf-40d9-9a07-d12933c0923b/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:16:06.765140 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [req-e0472892-eb8d-4545-8ec7-b6441be36347 req-871ae851-487c-4963-bfed-a1b945665048 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd8f2486-d4cf-40d9-9a07-d12933c0923b", "tag": "8d4969e6-911a-44ca-b161-644f80deb122"}]} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:16:06.773359 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-e0472892-eb8d-4545-8ec7-b6441be36347 req-871ae851-487c-4963-bfed-a1b945665048 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:16:06.773814 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-e0472892-eb8d-4545-8ec7-b6441be36347 req-871ae851-487c-4963-bfed-a1b945665048 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:16:06.786390 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.compute.server_external_events [req-e0472892-eb8d-4545-8ec7-b6441be36347 req-871ae851-487c-4963-bfed-a1b945665048 service nova] Creating event network-changed:8d4969e6-911a-44ca-b161-644f80deb122 for instance cd8f2486-d4cf-40d9-9a07-d12933c0923b on hv-cinder-83979 May 31 21:16:06.793231 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [req-e0472892-eb8d-4545-8ec7-b6441be36347 req-871ae851-487c-4963-bfed-a1b945665048 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087760 May 31 21:16:06.793453 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 554/1129] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:16:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:16:13.878130 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-8edf0363-74fa-4fca-80ac-67db1b589232 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "886484c8-578c-47e5-936d-5eda3e9ca469", "device": "/dev/sdb"}} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:16:13.879674 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-8edf0363-74fa-4fca-80ac-67db1b589232 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] [instance: 836874db-02ab-4f3d-8b87-d32c70829b1b] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:16:13.885697 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-8edf0363-74fa-4fca-80ac-67db1b589232 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:16:13.886184 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-8edf0363-74fa-4fca-80ac-67db1b589232 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:16:13.886954 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-8edf0363-74fa-4fca-80ac-67db1b589232 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:16:13.887596 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-8edf0363-74fa-4fca-80ac-67db1b589232 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:16:13.890146 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell1:SELECT=99 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:16:14.767120 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-8edf0363-74fa-4fca-80ac-67db1b589232 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] 10.222.0.55 "POST /compute/v2.1/servers/836874db-02ab-4f3d-8b87-d32c70829b1b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.893426 May 31 21:16:14.767724 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 576/1130] 10.222.0.55 () {60 vars in 1322 bytes} [Tue May 31 21:16:13 2022] POST /compute/v2.1/servers/836874db-02ab-4f3d-8b87-d32c70829b1b/os-volume_attachments => generated 194 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:16:46.673575 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=4 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:16:46.674447 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell1:SELECT=18 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:16:46.678592 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-c7c9018b-8fb4-4402-907f-d24f0c6db951 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:16:46.679176 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-c7c9018b-8fb4-4402-907f-d24f0c6db951 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] [instance: 836874db-02ab-4f3d-8b87-d32c70829b1b] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:16:46.685274 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c7c9018b-8fb4-4402-907f-d24f0c6db951 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:16:46.688363 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c7c9018b-8fb4-4402-907f-d24f0c6db951 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:16:46.688363 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c7c9018b-8fb4-4402-907f-d24f0c6db951 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:16:46.688363 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c7c9018b-8fb4-4402-907f-d24f0c6db951 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:16:46.772774 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.objects.instance [None req-c7c9018b-8fb4-4402-907f-d24f0c6db951 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lazy-loading 'services' on Instance uuid 836874db-02ab-4f3d-8b87-d32c70829b1b {{(pid=118185) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 21:16:47.003001 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-c7c9018b-8fb4-4402-907f-d24f0c6db951 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] 10.222.0.55 "DELETE /compute/v2.1/servers/836874db-02ab-4f3d-8b87-d32c70829b1b/os-volume_attachments/886484c8-578c-47e5-936d-5eda3e9ca469" status: 202 len: 0 microversion: 2.1 time: 0.330887 May 31 21:16:47.003598 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 555/1131] 10.222.0.55 () {58 vars in 1415 bytes} [Tue May 31 21:16:46 2022] DELETE /compute/v2.1/servers/836874db-02ab-4f3d-8b87-d32c70829b1b/os-volume_attachments/886484c8-578c-47e5-936d-5eda3e9ca469 => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 21:16:49.172201 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_api:SELECT=36 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:16:49.172981 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell1:SELECT=10,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:16:49.177109 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-603a87d8-7bf9-4a15-b514-572fb6852f05 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:16:49.177713 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-603a87d8-7bf9-4a15-b514-572fb6852f05 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] [instance: 836874db-02ab-4f3d-8b87-d32c70829b1b] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:16:49.184078 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-603a87d8-7bf9-4a15-b514-572fb6852f05 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:16:49.193271 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-603a87d8-7bf9-4a15-b514-572fb6852f05 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:16:49.193271 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-603a87d8-7bf9-4a15-b514-572fb6852f05 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:16:49.193271 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-603a87d8-7bf9-4a15-b514-572fb6852f05 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:16:49.210529 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-603a87d8-7bf9-4a15-b514-572fb6852f05 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] [instance: 836874db-02ab-4f3d-8b87-d32c70829b1b] Going to try to terminate instance {{(pid=118184) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 21:16:49.533260 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-603a87d8-7bf9-4a15-b514-572fb6852f05 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] 10.222.0.55 "DELETE /compute/v2.1/servers/836874db-02ab-4f3d-8b87-d32c70829b1b" status: 204 len: 0 microversion: 2.1 time: 0.362219 May 31 21:16:49.533858 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 577/1132] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 31 21:16:49 2022] DELETE /compute/v2.1/servers/836874db-02ab-4f3d-8b87-d32c70829b1b => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 31 21:16:49.543155 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-642160ae-0819-4ee2-bf0f-43ca329ba6c8 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:16:49.543887 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-642160ae-0819-4ee2-bf0f-43ca329ba6c8 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] [instance: 836874db-02ab-4f3d-8b87-d32c70829b1b] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:16:49.550458 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-642160ae-0819-4ee2-bf0f-43ca329ba6c8 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:16:49.551808 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-642160ae-0819-4ee2-bf0f-43ca329ba6c8 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:16:49.551808 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-642160ae-0819-4ee2-bf0f-43ca329ba6c8 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:16:49.552048 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-642160ae-0819-4ee2-bf0f-43ca329ba6c8 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:16:49.687527 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-642160ae-0819-4ee2-bf0f-43ca329ba6c8 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19f6c089e7ec4ca5914d760e742d89b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329e95cbfdb9493d82941bc00dd1ccbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:16:49.694886 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-642160ae-0819-4ee2-bf0f-43ca329ba6c8 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] 10.222.0.55 "GET /compute/v2.1/servers/836874db-02ab-4f3d-8b87-d32c70829b1b" status: 200 len: 1514 microversion: 2.1 time: 0.156449 May 31 21:16:49.695642 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 556/1133] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:16:49 2022] GET /compute/v2.1/servers/836874db-02ab-4f3d-8b87-d32c70829b1b => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:16:50.713541 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-7ea0506e-54eb-4136-98a0-34fbf6196001 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:16:50.714270 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-7ea0506e-54eb-4136-98a0-34fbf6196001 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] [instance: 836874db-02ab-4f3d-8b87-d32c70829b1b] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:16:50.720942 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7ea0506e-54eb-4136-98a0-34fbf6196001 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:16:50.721395 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7ea0506e-54eb-4136-98a0-34fbf6196001 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:16:50.722182 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7ea0506e-54eb-4136-98a0-34fbf6196001 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:16:50.722618 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-7ea0506e-54eb-4136-98a0-34fbf6196001 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:16:50.851495 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-7ea0506e-54eb-4136-98a0-34fbf6196001 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19f6c089e7ec4ca5914d760e742d89b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329e95cbfdb9493d82941bc00dd1ccbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:16:50.859408 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-7ea0506e-54eb-4136-98a0-34fbf6196001 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] 10.222.0.55 "GET /compute/v2.1/servers/836874db-02ab-4f3d-8b87-d32c70829b1b" status: 200 len: 1514 microversion: 2.1 time: 0.150118 May 31 21:16:50.859973 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 578/1134] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:16:50 2022] GET /compute/v2.1/servers/836874db-02ab-4f3d-8b87-d32c70829b1b => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:16:51.876755 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-8738c902-86a7-41cf-839a-9f2ec0454490 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:16:51.877364 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-8738c902-86a7-41cf-839a-9f2ec0454490 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] [instance: 836874db-02ab-4f3d-8b87-d32c70829b1b] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:16:51.884960 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-8738c902-86a7-41cf-839a-9f2ec0454490 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:16:51.885406 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-8738c902-86a7-41cf-839a-9f2ec0454490 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:16:51.886200 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-8738c902-86a7-41cf-839a-9f2ec0454490 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:16:51.886632 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-8738c902-86a7-41cf-839a-9f2ec0454490 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:16:52.019929 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-8738c902-86a7-41cf-839a-9f2ec0454490 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19f6c089e7ec4ca5914d760e742d89b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329e95cbfdb9493d82941bc00dd1ccbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:16:52.027486 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-8738c902-86a7-41cf-839a-9f2ec0454490 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] 10.222.0.55 "GET /compute/v2.1/servers/836874db-02ab-4f3d-8b87-d32c70829b1b" status: 200 len: 1514 microversion: 2.1 time: 0.154643 May 31 21:16:52.028139 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 557/1135] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:16:51 2022] GET /compute/v2.1/servers/836874db-02ab-4f3d-8b87-d32c70829b1b => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:16:52.154313 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [req-8e47cded-8be1-4cd7-a10e-27938cc238b6 req-58ca378a-470c-4dcb-bc80-364322f8cf3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "836874db-02ab-4f3d-8b87-d32c70829b1b", "name": "network-vif-deleted", "tag": "43ac5025-cbec-4c3e-a75a-05a41cfb775f"}]} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:16:52.162847 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-8e47cded-8be1-4cd7-a10e-27938cc238b6 req-58ca378a-470c-4dcb-bc80-364322f8cf3a service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:16:52.170549 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-8e47cded-8be1-4cd7-a10e-27938cc238b6 req-58ca378a-470c-4dcb-bc80-364322f8cf3a service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:16:52.173766 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.compute.server_external_events [req-8e47cded-8be1-4cd7-a10e-27938cc238b6 req-58ca378a-470c-4dcb-bc80-364322f8cf3a service nova] Creating event network-vif-deleted:43ac5025-cbec-4c3e-a75a-05a41cfb775f for instance 836874db-02ab-4f3d-8b87-d32c70829b1b on hv-cinder-83979 May 31 21:16:52.178759 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [req-8e47cded-8be1-4cd7-a10e-27938cc238b6 req-58ca378a-470c-4dcb-bc80-364322f8cf3a service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028196 May 31 21:16:52.179337 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 579/1136] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:16:53.044429 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-59ec1f63-08b1-4dc9-93eb-ab36f340848d tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:16:53.045040 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-59ec1f63-08b1-4dc9-93eb-ab36f340848d tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] [instance: 836874db-02ab-4f3d-8b87-d32c70829b1b] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:16:53.051525 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-59ec1f63-08b1-4dc9-93eb-ab36f340848d tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:16:53.051974 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-59ec1f63-08b1-4dc9-93eb-ab36f340848d tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:16:53.052744 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-59ec1f63-08b1-4dc9-93eb-ab36f340848d tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:16:53.053180 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-59ec1f63-08b1-4dc9-93eb-ab36f340848d tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:16:53.084364 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-59ec1f63-08b1-4dc9-93eb-ab36f340848d tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:16:53.084808 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-59ec1f63-08b1-4dc9-93eb-ab36f340848d tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:16:53.085256 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.objects.instance [None req-59ec1f63-08b1-4dc9-93eb-ab36f340848d tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lazy-loading 'fault' on Instance uuid 836874db-02ab-4f3d-8b87-d32c70829b1b {{(pid=118185) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 21:16:53.125639 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-59ec1f63-08b1-4dc9-93eb-ab36f340848d tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19f6c089e7ec4ca5914d760e742d89b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329e95cbfdb9493d82941bc00dd1ccbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:16:53.133087 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-59ec1f63-08b1-4dc9-93eb-ab36f340848d tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] 10.222.0.55 "GET /compute/v2.1/servers/836874db-02ab-4f3d-8b87-d32c70829b1b" status: 200 len: 1309 microversion: 2.1 time: 0.092964 May 31 21:16:53.134214 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 558/1137] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:16:53 2022] GET /compute/v2.1/servers/836874db-02ab-4f3d-8b87-d32c70829b1b => generated 1309 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:16:54.154306 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-90238c76-8d7c-4f61-94f8-4b1f2863fc62 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:16:54.155028 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-90238c76-8d7c-4f61-94f8-4b1f2863fc62 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] [instance: 836874db-02ab-4f3d-8b87-d32c70829b1b] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:16:54.161474 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-90238c76-8d7c-4f61-94f8-4b1f2863fc62 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:16:54.161954 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-90238c76-8d7c-4f61-94f8-4b1f2863fc62 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:16:54.162723 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-90238c76-8d7c-4f61-94f8-4b1f2863fc62 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:16:54.163157 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-90238c76-8d7c-4f61-94f8-4b1f2863fc62 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:16:54.176831 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.wsgi [None req-90238c76-8d7c-4f61-94f8-4b1f2863fc62 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] HTTP exception thrown: Instance 836874db-02ab-4f3d-8b87-d32c70829b1b could not be found. May 31 21:16:54.178493 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-90238c76-8d7c-4f61-94f8-4b1f2863fc62 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Request method failure captured: May 31 21:16:54.178493 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: request: GET /compute/v2.1/servers/836874db-02ab-4f3d-8b87-d32c70829b1b HTTP/1.1 May 31 21:16:54.178493 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Accept: application/json May 31 21:16:54.178493 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Accept-Encoding: identity May 31 21:16:54.178493 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Connection: close May 31 21:16:54.178493 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Content-Length: 0 May 31 21:16:54.178493 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Content-Type: application/json May 31 21:16:54.178493 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Host: 10.222.0.55 May 31 21:16:54.178493 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Openstack-System-Scope: None May 31 21:16:54.178493 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: User-Agent: python-urllib3/1.26.9 May 31 21:16:54.178493 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Auth-Token: gAAAAABiloVkHhi-QJtt66_5CZJxRlOhDICf0clSEP1r038DtEsEKOQIUVzRnMsfMCEwEM_ciQh_UgV1Sn7lMvI51zcb11O-O9eUxhJoOn1WxQPPkYzwguAKKI7Ef3IZffm-g9Q2APAKVDZpWyFNTrHs4SUoj30e9VXHmSGSLrSFAP7_rLKx2fg May 31 21:16:54.178493 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Domain-Id: None May 31 21:16:54.178493 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Domain-Name: None May 31 21:16:54.178493 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Identity-Status: Confirmed May 31 21:16:54.178493 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Is-Admin-Project: True May 31 21:16:54.178493 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Domain-Id: default May 31 21:16:54.178493 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Domain-Name: Default May 31 21:16:54.178493 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Id: 329e95cbfdb9493d82941bc00dd1ccbe May 31 21:16:54.178493 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1963511953 May 31 21:16:54.178493 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Role: member,reader May 31 21:16:54.178493 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Roles: member,reader May 31 21:16:54.180185 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/329e95cbfdb9493d82941bc00dd1ccbe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/329e95cbfdb9493d82941bc00dd1ccbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_329e95cbfdb9493d82941bc00dd1ccbe", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/329e95cbfdb9493d82941bc00dd1ccbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] May 31 21:16:54.180185 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant: tempest-VolumesSnapshotTestJSON-1963511953 May 31 21:16:54.180185 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant-Id: 329e95cbfdb9493d82941bc00dd1ccbe May 31 21:16:54.180185 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1963511953 May 31 21:16:54.180185 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User: tempest-VolumesSnapshotTestJSON-1963511953-project May 31 21:16:54.180185 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Domain-Id: default May 31 21:16:54.180185 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Domain-Name: Default May 31 21:16:54.180185 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Id: 19f6c089e7ec4ca5914d760e742d89b3 May 31 21:16:54.180185 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Name: tempest-VolumesSnapshotTestJSON-1963511953-project May 31 21:16:54.180185 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: method: > May 31 21:16:54.180185 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: exception: Instance 836874db-02ab-4f3d-8b87-d32c70829b1b could not be found. May 31 21:16:54.180185 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: action_args: {'id': '836874db-02ab-4f3d-8b87-d32c70829b1b'} May 31 21:16:54.181198 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 21:16:54.181198 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:16:54.181198 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 21:16:54.181198 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 21:16:54.181198 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 21:16:54.181198 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 21:16:54.181198 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 21:16:54.181198 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 21:16:54.181198 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 21:16:54.181198 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 21:16:54.181198 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 836874db-02ab-4f3d-8b87-d32c70829b1b could not be found. May 31 21:16:54.181198 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:16:54.181198 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:16:54.181198 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:16:54.181198 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:16:54.181198 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:16:54.181198 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:16:54.181198 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 21:16:54.181198 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 21:16:54.181198 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 21:16:54.182946 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 21:16:54.182946 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 21:16:54.182946 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 21:16:54.182946 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 21:16:54.182946 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 21:16:54.182946 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 21:16:54.182946 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 21:16:54.182946 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 836874db-02ab-4f3d-8b87-d32c70829b1b could not be found. May 31 21:16:54.182946 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:16:54.182946 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:16:54.182946 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:16:54.182946 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:16:54.182946 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:16:54.182946 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:16:54.182946 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 21:16:54.182946 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 21:16:54.182946 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 836874db-02ab-4f3d-8b87-d32c70829b1b could not be found. May 31 21:16:54.182946 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:16:54.184729 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-90238c76-8d7c-4f61-94f8-4b1f2863fc62 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Returning 404 to user: Instance 836874db-02ab-4f3d-8b87-d32c70829b1b could not be found. {{(pid=118184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 21:16:54.184729 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-90238c76-8d7c-4f61-94f8-4b1f2863fc62 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] 10.222.0.55 "GET /compute/v2.1/servers/836874db-02ab-4f3d-8b87-d32c70829b1b" status: 404 len: 111 microversion: 2.1 time: 0.030998 May 31 21:16:54.184729 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 580/1138] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:16:54 2022] GET /compute/v2.1/servers/836874db-02ab-4f3d-8b87-d32c70829b1b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 21:17:04.634312 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-52471ea4-d461-4c6c-ae3b-90b72ae8e7db tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:17:04.635378 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [req-565a7851-68e1-429d-9a08-7f7b02c8815b req-d500e033-9962-49a5-b608-63efa9a58d10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cb3ce1b-f994-4a4b-9f06-12a001fcd081", "tag": "b6ddeae7-2540-4694-af04-5e45ce14eb5e"}]} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:17:04.635773 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-52471ea4-d461-4c6c-ae3b-90b72ae8e7db tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 1cb3ce1b-f994-4a4b-9f06-12a001fcd081] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:17:04.638524 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_api:SELECT=10 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:17:04.639270 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:17:04.640707 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:17:04.641777 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:17:04.644739 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-52471ea4-d461-4c6c-ae3b-90b72ae8e7db tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:04.645202 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-52471ea4-d461-4c6c-ae3b-90b72ae8e7db tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:04.646255 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-52471ea4-d461-4c6c-ae3b-90b72ae8e7db tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:04.646897 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-52471ea4-d461-4c6c-ae3b-90b72ae8e7db tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:04.651693 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-565a7851-68e1-429d-9a08-7f7b02c8815b req-d500e033-9962-49a5-b608-63efa9a58d10 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:04.651693 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-565a7851-68e1-429d-9a08-7f7b02c8815b req-d500e033-9962-49a5-b608-63efa9a58d10 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:04.660387 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.compute.server_external_events [req-565a7851-68e1-429d-9a08-7f7b02c8815b req-d500e033-9962-49a5-b608-63efa9a58d10 service nova] Creating event network-changed:b6ddeae7-2540-4694-af04-5e45ce14eb5e for instance 1cb3ce1b-f994-4a4b-9f06-12a001fcd081 on hv-cinder-83979 May 31 21:17:04.666345 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [req-565a7851-68e1-429d-9a08-7f7b02c8815b req-d500e033-9962-49a5-b608-63efa9a58d10 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034842 May 31 21:17:04.668005 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 581/1139] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:17:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 21:17:04.676630 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-52471ea4-d461-4c6c-ae3b-90b72ae8e7db tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 1cb3ce1b-f994-4a4b-9f06-12a001fcd081] Going to try to terminate instance {{(pid=118185) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 21:17:04.934293 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-52471ea4-d461-4c6c-ae3b-90b72ae8e7db tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "DELETE /compute/v2.1/servers/1cb3ce1b-f994-4a4b-9f06-12a001fcd081" status: 204 len: 0 microversion: 2.1 time: 0.303797 May 31 21:17:04.935530 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 559/1140] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 31 21:17:04 2022] DELETE /compute/v2.1/servers/1cb3ce1b-f994-4a4b-9f06-12a001fcd081 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 31 21:17:04.944279 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-c028b690-5470-4b7d-8c33-64d3590a64ae tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:17:04.945060 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-c028b690-5470-4b7d-8c33-64d3590a64ae tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 1cb3ce1b-f994-4a4b-9f06-12a001fcd081] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:17:04.952561 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c028b690-5470-4b7d-8c33-64d3590a64ae tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:04.954542 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c028b690-5470-4b7d-8c33-64d3590a64ae tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:04.954542 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c028b690-5470-4b7d-8c33-64d3590a64ae tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:04.954542 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c028b690-5470-4b7d-8c33-64d3590a64ae tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:05.101307 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-c028b690-5470-4b7d-8c33-64d3590a64ae tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:17:05.108878 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-c028b690-5470-4b7d-8c33-64d3590a64ae tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/1cb3ce1b-f994-4a4b-9f06-12a001fcd081" status: 200 len: 1577 microversion: 2.1 time: 0.169385 May 31 21:17:05.109677 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 582/1141] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:17:04 2022] GET /compute/v2.1/servers/1cb3ce1b-f994-4a4b-9f06-12a001fcd081 => generated 1577 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:17:06.127259 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-556c2511-c783-49cf-b810-192547c29cbf tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:17:06.127965 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-556c2511-c783-49cf-b810-192547c29cbf tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 1cb3ce1b-f994-4a4b-9f06-12a001fcd081] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:17:06.135720 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-556c2511-c783-49cf-b810-192547c29cbf tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:06.136167 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-556c2511-c783-49cf-b810-192547c29cbf tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:06.136954 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-556c2511-c783-49cf-b810-192547c29cbf tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:06.137390 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-556c2511-c783-49cf-b810-192547c29cbf tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:06.272670 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-556c2511-c783-49cf-b810-192547c29cbf tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:17:06.281009 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-556c2511-c783-49cf-b810-192547c29cbf tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/1cb3ce1b-f994-4a4b-9f06-12a001fcd081" status: 200 len: 1577 microversion: 2.1 time: 0.158302 May 31 21:17:06.281582 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 560/1142] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:17:06 2022] GET /compute/v2.1/servers/1cb3ce1b-f994-4a4b-9f06-12a001fcd081 => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:17:07.299814 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-ad354c92-1b8e-4e49-914e-8641dd7f0755 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:17:07.300416 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-ad354c92-1b8e-4e49-914e-8641dd7f0755 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 1cb3ce1b-f994-4a4b-9f06-12a001fcd081] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:17:07.307123 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ad354c92-1b8e-4e49-914e-8641dd7f0755 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:07.307569 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ad354c92-1b8e-4e49-914e-8641dd7f0755 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:07.308330 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ad354c92-1b8e-4e49-914e-8641dd7f0755 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:07.308767 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ad354c92-1b8e-4e49-914e-8641dd7f0755 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:07.438105 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-ad354c92-1b8e-4e49-914e-8641dd7f0755 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:17:07.446136 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-ad354c92-1b8e-4e49-914e-8641dd7f0755 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/1cb3ce1b-f994-4a4b-9f06-12a001fcd081" status: 200 len: 1577 microversion: 2.1 time: 0.150533 May 31 21:17:07.446724 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 583/1143] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:17:07 2022] GET /compute/v2.1/servers/1cb3ce1b-f994-4a4b-9f06-12a001fcd081 => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:17:08.463268 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-2f494869-45e0-4651-bdc6-bd579fb9e5b6 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:17:08.464024 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-2f494869-45e0-4651-bdc6-bd579fb9e5b6 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 1cb3ce1b-f994-4a4b-9f06-12a001fcd081] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:17:08.470592 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-2f494869-45e0-4651-bdc6-bd579fb9e5b6 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:08.471054 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-2f494869-45e0-4651-bdc6-bd579fb9e5b6 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:08.471831 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-2f494869-45e0-4651-bdc6-bd579fb9e5b6 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:08.472277 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-2f494869-45e0-4651-bdc6-bd579fb9e5b6 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:08.606817 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-2f494869-45e0-4651-bdc6-bd579fb9e5b6 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:17:08.614733 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-2f494869-45e0-4651-bdc6-bd579fb9e5b6 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/1cb3ce1b-f994-4a4b-9f06-12a001fcd081" status: 200 len: 1577 microversion: 2.1 time: 0.155735 May 31 21:17:08.615439 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 561/1144] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:17:08 2022] GET /compute/v2.1/servers/1cb3ce1b-f994-4a4b-9f06-12a001fcd081 => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:17:08.694894 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-b6974b71-4a8c-426d-bd90-d18556be832a tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-871580727", "imageRef": "21b89996-9e87-489d-8891-305f6c3d905a", "flavorRef": "452", "networks": [{"uuid": "710ad2ad-e004-4b3f-9e04-41d28feb1281"}]}} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:17:08.750521 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.network.neutron [None req-b6974b71-4a8c-426d-bd90-d18556be832a tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] validate_networks() for [('710ad2ad-e004-4b3f-9e04-41d28feb1281', None, None, None, None, None)] {{(pid=118184) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 21:17:09.052723 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [req-a7637fc7-bb85-450a-b474-bacc60d1b222 req-76c6a3f0-fc17-4731-a292-29c36ea19255 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cb3ce1b-f994-4a4b-9f06-12a001fcd081", "name": "network-vif-deleted", "tag": "b6ddeae7-2540-4694-af04-5e45ce14eb5e"}]} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:17:09.060893 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-a7637fc7-bb85-450a-b474-bacc60d1b222 req-76c6a3f0-fc17-4731-a292-29c36ea19255 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:09.063796 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-a7637fc7-bb85-450a-b474-bacc60d1b222 req-76c6a3f0-fc17-4731-a292-29c36ea19255 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:09.076034 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.compute.server_external_events [req-a7637fc7-bb85-450a-b474-bacc60d1b222 req-76c6a3f0-fc17-4731-a292-29c36ea19255 service nova] Creating event network-vif-deleted:b6ddeae7-2540-4694-af04-5e45ce14eb5e for instance 1cb3ce1b-f994-4a4b-9f06-12a001fcd081 on hv-cinder-83979 May 31 21:17:09.081017 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [req-a7637fc7-bb85-450a-b474-bacc60d1b222 req-76c6a3f0-fc17-4731-a292-29c36ea19255 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031971 May 31 21:17:09.081811 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 562/1145] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:17:09.160301 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.virt.hardware [None req-b6974b71-4a8c-426d-bd90-d18556be832a tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Flavor limits 0:0:0 {{(pid=118184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 21:17:09.160966 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.virt.hardware [None req-b6974b71-4a8c-426d-bd90-d18556be832a tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Image limits 0:0:0 {{(pid=118184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 21:17:09.161588 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.virt.hardware [None req-b6974b71-4a8c-426d-bd90-d18556be832a tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Flavor pref 0:0:0 {{(pid=118184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 21:17:09.162227 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.virt.hardware [None req-b6974b71-4a8c-426d-bd90-d18556be832a tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Image pref 0:0:0 {{(pid=118184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 21:17:09.162709 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.virt.hardware [None req-b6974b71-4a8c-426d-bd90-d18556be832a tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 21:17:09.171858 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b6974b71-4a8c-426d-bd90-d18556be832a tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:09.172403 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b6974b71-4a8c-426d-bd90-d18556be832a tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:09.173278 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b6974b71-4a8c-426d-bd90-d18556be832a tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:09.173781 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b6974b71-4a8c-426d-bd90-d18556be832a tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:09.191251 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.quota [None req-b6974b71-4a8c-426d-bd90-d18556be832a tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Getting quotas for project 329e95cbfdb9493d82941bc00dd1ccbe. Resources: {'ram', 'cores', 'instances'} {{(pid=118184) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 21:17:09.195792 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.quota [None req-b6974b71-4a8c-426d-bd90-d18556be832a tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Getting quotas for user 19f6c089e7ec4ca5914d760e742d89b3 and project 329e95cbfdb9493d82941bc00dd1ccbe. Resources: {'ram', 'cores', 'instances'} {{(pid=118184) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 21:17:09.208783 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-b6974b71-4a8c-426d-bd90-d18556be832a tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Going to run 1 instances... {{(pid=118184) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 21:17:09.211128 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-b6974b71-4a8c-426d-bd90-d18556be832a tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] [instance: 5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='21b89996-9e87-489d-8891-305f6c3d905a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118184) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 21:17:09.383906 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-b6974b71-4a8c-426d-bd90-d18556be832a tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.692738 May 31 21:17:09.386576 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 584/1146] 10.222.0.55 () {60 vars in 1146 bytes} [Tue May 31 21:17:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 31 21:17:09.395666 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-b0ed7e8c-7b42-45f6-b58b-8b85eb1d5a18 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:17:09.396627 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-b0ed7e8c-7b42-45f6-b58b-8b85eb1d5a18 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] [instance: 5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:17:09.465063 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-b0ed7e8c-7b42-45f6-b58b-8b85eb1d5a18 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19f6c089e7ec4ca5914d760e742d89b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329e95cbfdb9493d82941bc00dd1ccbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:17:09.473179 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-b0ed7e8c-7b42-45f6-b58b-8b85eb1d5a18 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] 10.222.0.55 "GET /compute/v2.1/servers/5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf" status: 200 len: 1218 microversion: 2.1 time: 0.081885 May 31 21:17:09.473765 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 563/1147] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:17:09 2022] GET /compute/v2.1/servers/5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:17:09.632885 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-d84dae9a-427c-4962-9890-a2c9678d8275 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:17:09.633436 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-d84dae9a-427c-4962-9890-a2c9678d8275 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 1cb3ce1b-f994-4a4b-9f06-12a001fcd081] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:17:09.640065 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d84dae9a-427c-4962-9890-a2c9678d8275 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:09.640617 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d84dae9a-427c-4962-9890-a2c9678d8275 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:09.641385 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d84dae9a-427c-4962-9890-a2c9678d8275 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:09.641813 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d84dae9a-427c-4962-9890-a2c9678d8275 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:09.708549 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-d84dae9a-427c-4962-9890-a2c9678d8275 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:17:09.717056 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-d84dae9a-427c-4962-9890-a2c9678d8275 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/1cb3ce1b-f994-4a4b-9f06-12a001fcd081" status: 200 len: 1226 microversion: 2.1 time: 0.088356 May 31 21:17:09.717619 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 585/1148] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:17:09 2022] GET /compute/v2.1/servers/1cb3ce1b-f994-4a4b-9f06-12a001fcd081 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:17:10.491113 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-ce96a877-1937-4116-8413-99df97f0f738 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:17:10.491918 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-ce96a877-1937-4116-8413-99df97f0f738 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] [instance: 5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:17:10.500087 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ce96a877-1937-4116-8413-99df97f0f738 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:10.500531 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ce96a877-1937-4116-8413-99df97f0f738 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:10.501293 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ce96a877-1937-4116-8413-99df97f0f738 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:10.501728 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ce96a877-1937-4116-8413-99df97f0f738 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:10.565729 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-ce96a877-1937-4116-8413-99df97f0f738 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19f6c089e7ec4ca5914d760e742d89b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329e95cbfdb9493d82941bc00dd1ccbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:17:10.573713 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-ce96a877-1937-4116-8413-99df97f0f738 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] 10.222.0.55 "GET /compute/v2.1/servers/5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf" status: 200 len: 1222 microversion: 2.1 time: 0.086929 May 31 21:17:10.574250 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 564/1149] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:17:10 2022] GET /compute/v2.1/servers/5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf => generated 1222 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:17:10.733624 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-ea757af9-8e3f-4bfd-8a8a-3de5a973e659 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:17:10.734272 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-ea757af9-8e3f-4bfd-8a8a-3de5a973e659 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 1cb3ce1b-f994-4a4b-9f06-12a001fcd081] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:17:10.740779 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ea757af9-8e3f-4bfd-8a8a-3de5a973e659 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:10.741236 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ea757af9-8e3f-4bfd-8a8a-3de5a973e659 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:10.742583 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ea757af9-8e3f-4bfd-8a8a-3de5a973e659 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:10.743045 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-ea757af9-8e3f-4bfd-8a8a-3de5a973e659 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:10.756527 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.wsgi [None req-ea757af9-8e3f-4bfd-8a8a-3de5a973e659 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] HTTP exception thrown: Instance 1cb3ce1b-f994-4a4b-9f06-12a001fcd081 could not be found. May 31 21:17:10.758853 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-ea757af9-8e3f-4bfd-8a8a-3de5a973e659 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Request method failure captured: May 31 21:17:10.758853 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: request: GET /compute/v2.1/servers/1cb3ce1b-f994-4a4b-9f06-12a001fcd081 HTTP/1.1 May 31 21:17:10.758853 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Accept: application/json May 31 21:17:10.758853 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Accept-Encoding: identity May 31 21:17:10.758853 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Connection: close May 31 21:17:10.758853 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Content-Length: 0 May 31 21:17:10.758853 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Content-Type: application/json May 31 21:17:10.758853 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Host: 10.222.0.55 May 31 21:17:10.758853 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Openstack-System-Scope: None May 31 21:17:10.758853 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: User-Agent: python-urllib3/1.26.9 May 31 21:17:10.758853 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Auth-Token: gAAAAABiloOgTfUO-lc7nDbKdfWKqO62bw1HfA7dgbwFJLheVHCZ2y6EF_fvHD4X3sHUmdUzsBqmSOFIsvCVJUmPvIr-lVLeVzFeCCM4eyesBpMRiqru6yEXb3xLsTUiiV10djblIsjlqlgif1nnW_lIm6b4EE-6k61w7JcDt3BQ6dUVTmkqiv8 May 31 21:17:10.758853 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Domain-Id: None May 31 21:17:10.758853 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Domain-Name: None May 31 21:17:10.758853 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Identity-Status: Confirmed May 31 21:17:10.758853 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Is-Admin-Project: True May 31 21:17:10.758853 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Domain-Id: default May 31 21:17:10.758853 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Domain-Name: Default May 31 21:17:10.758853 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Id: 8e511490c0f8438fb89ac590bd63529f May 31 21:17:10.758853 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Name: tempest-TestVolumeBootPattern-1802532727 May 31 21:17:10.758853 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Role: member,reader May 31 21:17:10.758853 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Roles: member,reader May 31 21:17:10.760590 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/8e511490c0f8438fb89ac590bd63529f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/8e511490c0f8438fb89ac590bd63529f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_8e511490c0f8438fb89ac590bd63529f", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/8e511490c0f8438fb89ac590bd63529f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] May 31 21:17:10.760590 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant: tempest-TestVolumeBootPattern-1802532727 May 31 21:17:10.760590 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant-Id: 8e511490c0f8438fb89ac590bd63529f May 31 21:17:10.760590 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant-Name: tempest-TestVolumeBootPattern-1802532727 May 31 21:17:10.760590 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User: tempest-TestVolumeBootPattern-1802532727-project May 31 21:17:10.760590 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Domain-Id: default May 31 21:17:10.760590 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Domain-Name: Default May 31 21:17:10.760590 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Id: 546cd066c4244bffacbfea21f5e4f437 May 31 21:17:10.760590 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Name: tempest-TestVolumeBootPattern-1802532727-project May 31 21:17:10.760590 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: method: > May 31 21:17:10.760590 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: exception: Instance 1cb3ce1b-f994-4a4b-9f06-12a001fcd081 could not be found. May 31 21:17:10.760590 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: action_args: {'id': '1cb3ce1b-f994-4a4b-9f06-12a001fcd081'} May 31 21:17:10.761482 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 21:17:10.761482 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:17:10.761482 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 21:17:10.761482 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 21:17:10.761482 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 21:17:10.761482 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 21:17:10.761482 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 21:17:10.761482 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 21:17:10.761482 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 21:17:10.761482 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 21:17:10.761482 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cb3ce1b-f994-4a4b-9f06-12a001fcd081 could not be found. May 31 21:17:10.761482 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:17:10.761482 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:17:10.761482 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:17:10.761482 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:17:10.761482 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:17:10.761482 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:17:10.761482 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 21:17:10.761482 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 21:17:10.761482 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 21:17:10.762765 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 21:17:10.762765 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 21:17:10.762765 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 21:17:10.762765 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 21:17:10.762765 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 21:17:10.762765 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 21:17:10.762765 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 21:17:10.762765 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cb3ce1b-f994-4a4b-9f06-12a001fcd081 could not be found. May 31 21:17:10.762765 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:17:10.762765 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:17:10.762765 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:17:10.762765 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:17:10.762765 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:17:10.762765 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:17:10.762765 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 21:17:10.762765 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 21:17:10.762765 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cb3ce1b-f994-4a4b-9f06-12a001fcd081 could not be found. May 31 21:17:10.762765 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:17:10.763912 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-ea757af9-8e3f-4bfd-8a8a-3de5a973e659 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Returning 404 to user: Instance 1cb3ce1b-f994-4a4b-9f06-12a001fcd081 could not be found. {{(pid=118184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 21:17:10.763912 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-ea757af9-8e3f-4bfd-8a8a-3de5a973e659 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/1cb3ce1b-f994-4a4b-9f06-12a001fcd081" status: 404 len: 111 microversion: 2.1 time: 0.030419 May 31 21:17:10.763912 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 586/1150] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:17:10 2022] GET /compute/v2.1/servers/1cb3ce1b-f994-4a4b-9f06-12a001fcd081 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 21:17:11.591867 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-5d8ced10-5220-4ab9-b42f-cd4537c6a679 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:17:11.592454 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-5d8ced10-5220-4ab9-b42f-cd4537c6a679 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] [instance: 5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:17:11.600630 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-5d8ced10-5220-4ab9-b42f-cd4537c6a679 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:11.601083 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-5d8ced10-5220-4ab9-b42f-cd4537c6a679 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:11.601885 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-5d8ced10-5220-4ab9-b42f-cd4537c6a679 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:11.602997 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-5d8ced10-5220-4ab9-b42f-cd4537c6a679 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:11.665635 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-5d8ced10-5220-4ab9-b42f-cd4537c6a679 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19f6c089e7ec4ca5914d760e742d89b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329e95cbfdb9493d82941bc00dd1ccbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:17:11.673125 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-5d8ced10-5220-4ab9-b42f-cd4537c6a679 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] 10.222.0.55 "GET /compute/v2.1/servers/5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf" status: 200 len: 1288 microversion: 2.1 time: 0.085480 May 31 21:17:11.673695 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 565/1151] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:17:11 2022] GET /compute/v2.1/servers/5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf => generated 1288 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:17:12.690889 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-acb32bd7-3bf0-4849-a61a-5a20269dc7d1 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:17:12.691520 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-acb32bd7-3bf0-4849-a61a-5a20269dc7d1 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] [instance: 5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:17:12.697605 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-acb32bd7-3bf0-4849-a61a-5a20269dc7d1 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:12.698089 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-acb32bd7-3bf0-4849-a61a-5a20269dc7d1 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:12.698858 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-acb32bd7-3bf0-4849-a61a-5a20269dc7d1 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:12.699299 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-acb32bd7-3bf0-4849-a61a-5a20269dc7d1 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:12.830825 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-acb32bd7-3bf0-4849-a61a-5a20269dc7d1 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19f6c089e7ec4ca5914d760e742d89b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329e95cbfdb9493d82941bc00dd1ccbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:17:12.839121 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-acb32bd7-3bf0-4849-a61a-5a20269dc7d1 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] 10.222.0.55 "GET /compute/v2.1/servers/5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf" status: 200 len: 1318 microversion: 2.1 time: 0.152331 May 31 21:17:12.839689 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 587/1152] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:17:12 2022] GET /compute/v2.1/servers/5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:17:13.155253 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [req-63a8aece-a318-4857-ab55-4d8ff8e9af03 req-540eb49b-bb9f-4105-8e42-d06a2d9217b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf", "tag": "547f16e2-0ced-4efc-8ab6-8cdc9c735022"}]} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:17:13.163949 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-63a8aece-a318-4857-ab55-4d8ff8e9af03 req-540eb49b-bb9f-4105-8e42-d06a2d9217b3 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:13.164477 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-63a8aece-a318-4857-ab55-4d8ff8e9af03 req-540eb49b-bb9f-4105-8e42-d06a2d9217b3 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:13.176501 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.compute.server_external_events [req-63a8aece-a318-4857-ab55-4d8ff8e9af03 req-540eb49b-bb9f-4105-8e42-d06a2d9217b3 service nova] Creating event network-changed:547f16e2-0ced-4efc-8ab6-8cdc9c735022 for instance 5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf on hv-cinder-83979 May 31 21:17:13.181404 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [req-63a8aece-a318-4857-ab55-4d8ff8e9af03 req-540eb49b-bb9f-4105-8e42-d06a2d9217b3 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030104 May 31 21:17:13.182296 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 566/1153] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:17:13.858873 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-097ec5fb-0126-4862-ab15-ddbdd2a47f36 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:17:13.859508 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-097ec5fb-0126-4862-ab15-ddbdd2a47f36 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] [instance: 5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:17:13.865872 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-097ec5fb-0126-4862-ab15-ddbdd2a47f36 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:13.866370 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-097ec5fb-0126-4862-ab15-ddbdd2a47f36 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:13.867191 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-097ec5fb-0126-4862-ab15-ddbdd2a47f36 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:13.868275 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-097ec5fb-0126-4862-ab15-ddbdd2a47f36 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:14.004292 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-097ec5fb-0126-4862-ab15-ddbdd2a47f36 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19f6c089e7ec4ca5914d760e742d89b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329e95cbfdb9493d82941bc00dd1ccbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:17:14.012499 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-097ec5fb-0126-4862-ab15-ddbdd2a47f36 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] 10.222.0.55 "GET /compute/v2.1/servers/5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf" status: 200 len: 1318 microversion: 2.1 time: 0.157412 May 31 21:17:14.013071 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 588/1154] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:17:13 2022] GET /compute/v2.1/servers/5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:17:14.748241 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-9437f19d-9a0a-471f-b751-0236e6af7672 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:17:14.748824 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-9437f19d-9a0a-471f-b751-0236e6af7672 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 48d80d94-ed1f-4792-955f-5ac166350cb8] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:17:14.755071 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9437f19d-9a0a-471f-b751-0236e6af7672 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:14.755526 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9437f19d-9a0a-471f-b751-0236e6af7672 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:14.756299 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9437f19d-9a0a-471f-b751-0236e6af7672 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:14.756735 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9437f19d-9a0a-471f-b751-0236e6af7672 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:14.782710 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-9437f19d-9a0a-471f-b751-0236e6af7672 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 48d80d94-ed1f-4792-955f-5ac166350cb8] Going to try to terminate instance {{(pid=118185) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 21:17:15.029170 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-20dc101e-ed27-4b54-ae82-ac336308ee26 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:17:15.029788 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-20dc101e-ed27-4b54-ae82-ac336308ee26 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] [instance: 5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:17:15.036439 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-20dc101e-ed27-4b54-ae82-ac336308ee26 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:15.040757 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-20dc101e-ed27-4b54-ae82-ac336308ee26 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:15.040757 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-20dc101e-ed27-4b54-ae82-ac336308ee26 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:15.040757 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-20dc101e-ed27-4b54-ae82-ac336308ee26 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:15.059574 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-9437f19d-9a0a-471f-b751-0236e6af7672 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "DELETE /compute/v2.1/servers/48d80d94-ed1f-4792-955f-5ac166350cb8" status: 204 len: 0 microversion: 2.1 time: 0.315717 May 31 21:17:15.063140 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 567/1155] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 31 21:17:14 2022] DELETE /compute/v2.1/servers/48d80d94-ed1f-4792-955f-5ac166350cb8 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 31 21:17:15.068745 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-b3524bfe-abe5-44da-94f4-c21281227402 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:17:15.074258 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-b3524bfe-abe5-44da-94f4-c21281227402 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 48d80d94-ed1f-4792-955f-5ac166350cb8] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:17:15.080760 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b3524bfe-abe5-44da-94f4-c21281227402 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:15.081341 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b3524bfe-abe5-44da-94f4-c21281227402 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:15.082165 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b3524bfe-abe5-44da-94f4-c21281227402 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:15.082610 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b3524bfe-abe5-44da-94f4-c21281227402 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:15.242056 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-20dc101e-ed27-4b54-ae82-ac336308ee26 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19f6c089e7ec4ca5914d760e742d89b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329e95cbfdb9493d82941bc00dd1ccbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:17:15.250980 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-20dc101e-ed27-4b54-ae82-ac336308ee26 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] 10.222.0.55 "GET /compute/v2.1/servers/5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf" status: 200 len: 1318 microversion: 2.1 time: 0.225118 May 31 21:17:15.251564 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 589/1156] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:17:15 2022] GET /compute/v2.1/servers/5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:17:15.256387 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [req-dbaeb5e2-68d4-4655-8f31-83458cc5b1e1 req-2b14ad11-a375-4ef2-8dff-7ab4ee55e29e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48d80d94-ed1f-4792-955f-5ac166350cb8", "tag": "be6188bf-51f6-4051-bc2f-677f9aefbc61"}]} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:17:15.268309 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-dbaeb5e2-68d4-4655-8f31-83458cc5b1e1 req-2b14ad11-a375-4ef2-8dff-7ab4ee55e29e service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:15.268815 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-dbaeb5e2-68d4-4655-8f31-83458cc5b1e1 req-2b14ad11-a375-4ef2-8dff-7ab4ee55e29e service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:15.275588 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-b3524bfe-abe5-44da-94f4-c21281227402 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:17:15.281028 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.compute.server_external_events [req-dbaeb5e2-68d4-4655-8f31-83458cc5b1e1 req-2b14ad11-a375-4ef2-8dff-7ab4ee55e29e service nova] Creating event network-changed:be6188bf-51f6-4051-bc2f-677f9aefbc61 for instance 48d80d94-ed1f-4792-955f-5ac166350cb8 on hv-cinder-83979 May 31 21:17:15.283582 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-b3524bfe-abe5-44da-94f4-c21281227402 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/48d80d94-ed1f-4792-955f-5ac166350cb8" status: 200 len: 1578 microversion: 2.1 time: 0.218819 May 31 21:17:15.284384 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 568/1157] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:17:15 2022] GET /compute/v2.1/servers/48d80d94-ed1f-4792-955f-5ac166350cb8 => generated 1578 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:17:15.295858 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [req-dbaeb5e2-68d4-4655-8f31-83458cc5b1e1 req-2b14ad11-a375-4ef2-8dff-7ab4ee55e29e service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042901 May 31 21:17:15.296458 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 590/1158] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:17:16.268554 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-870e9afa-070d-467e-b537-5250f7871bf5 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:17:16.269245 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-870e9afa-070d-467e-b537-5250f7871bf5 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] [instance: 5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:17:16.276480 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-870e9afa-070d-467e-b537-5250f7871bf5 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:16.276951 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-870e9afa-070d-467e-b537-5250f7871bf5 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:16.277716 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-870e9afa-070d-467e-b537-5250f7871bf5 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:16.278174 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-870e9afa-070d-467e-b537-5250f7871bf5 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:16.301519 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-9c9fc5d8-4527-488f-b536-6e74970e565b tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:17:16.302445 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-9c9fc5d8-4527-488f-b536-6e74970e565b tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 48d80d94-ed1f-4792-955f-5ac166350cb8] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:17:16.308738 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-9c9fc5d8-4527-488f-b536-6e74970e565b tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:16.309181 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-9c9fc5d8-4527-488f-b536-6e74970e565b tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:16.309974 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-9c9fc5d8-4527-488f-b536-6e74970e565b tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:16.310407 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-9c9fc5d8-4527-488f-b536-6e74970e565b tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:16.462370 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-870e9afa-070d-467e-b537-5250f7871bf5 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19f6c089e7ec4ca5914d760e742d89b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329e95cbfdb9493d82941bc00dd1ccbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:17:16.469757 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-870e9afa-070d-467e-b537-5250f7871bf5 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] 10.222.0.55 "GET /compute/v2.1/servers/5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf" status: 200 len: 1318 microversion: 2.1 time: 0.205018 May 31 21:17:16.470563 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 569/1159] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:17:16 2022] GET /compute/v2.1/servers/5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf => generated 1318 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:17:16.493915 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-9c9fc5d8-4527-488f-b536-6e74970e565b tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:17:16.501498 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-9c9fc5d8-4527-488f-b536-6e74970e565b tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/48d80d94-ed1f-4792-955f-5ac166350cb8" status: 200 len: 1578 microversion: 2.1 time: 0.204596 May 31 21:17:16.502100 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 591/1160] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:17:16 2022] GET /compute/v2.1/servers/48d80d94-ed1f-4792-955f-5ac166350cb8 => generated 1578 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:17:17.486510 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-072f4e0d-6586-421e-ae70-c3497ae9fb36 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:17:17.487194 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-072f4e0d-6586-421e-ae70-c3497ae9fb36 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] [instance: 5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:17:17.494189 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-072f4e0d-6586-421e-ae70-c3497ae9fb36 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:17.494634 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-072f4e0d-6586-421e-ae70-c3497ae9fb36 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:17.495389 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-072f4e0d-6586-421e-ae70-c3497ae9fb36 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:17.495830 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-072f4e0d-6586-421e-ae70-c3497ae9fb36 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:17.525794 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-cb2b7385-bd13-4612-af48-238b60b15186 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:17:17.526527 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-cb2b7385-bd13-4612-af48-238b60b15186 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 48d80d94-ed1f-4792-955f-5ac166350cb8] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:17:17.532848 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-cb2b7385-bd13-4612-af48-238b60b15186 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:17.533297 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-cb2b7385-bd13-4612-af48-238b60b15186 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:17.534100 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-cb2b7385-bd13-4612-af48-238b60b15186 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:17.534532 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-cb2b7385-bd13-4612-af48-238b60b15186 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:17.681038 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-072f4e0d-6586-421e-ae70-c3497ae9fb36 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19f6c089e7ec4ca5914d760e742d89b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329e95cbfdb9493d82941bc00dd1ccbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:17:17.688537 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-072f4e0d-6586-421e-ae70-c3497ae9fb36 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] 10.222.0.55 "GET /compute/v2.1/servers/5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf" status: 200 len: 1318 microversion: 2.1 time: 0.205878 May 31 21:17:17.689107 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 570/1161] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:17:17 2022] GET /compute/v2.1/servers/5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf => generated 1318 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:17:17.704812 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-cb2b7385-bd13-4612-af48-238b60b15186 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:17:17.712966 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-cb2b7385-bd13-4612-af48-238b60b15186 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/48d80d94-ed1f-4792-955f-5ac166350cb8" status: 200 len: 1460 microversion: 2.1 time: 0.190985 May 31 21:17:17.713618 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 592/1162] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:17:17 2022] GET /compute/v2.1/servers/48d80d94-ed1f-4792-955f-5ac166350cb8 => generated 1460 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:17:18.420328 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [req-e5da7843-ee4e-4831-ac6a-3d52d0f49fe0 req-275137b2-897b-40c1-ad86-e54e29280660 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48d80d94-ed1f-4792-955f-5ac166350cb8", "name": "network-vif-deleted", "tag": "be6188bf-51f6-4051-bc2f-677f9aefbc61"}]} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:17:18.428423 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-e5da7843-ee4e-4831-ac6a-3d52d0f49fe0 req-275137b2-897b-40c1-ad86-e54e29280660 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:18.428865 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-e5da7843-ee4e-4831-ac6a-3d52d0f49fe0 req-275137b2-897b-40c1-ad86-e54e29280660 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:18.440104 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.compute.server_external_events [req-e5da7843-ee4e-4831-ac6a-3d52d0f49fe0 req-275137b2-897b-40c1-ad86-e54e29280660 service nova] Creating event network-vif-deleted:be6188bf-51f6-4051-bc2f-677f9aefbc61 for instance 48d80d94-ed1f-4792-955f-5ac166350cb8 on hv-cinder-83979 May 31 21:17:18.445305 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [req-e5da7843-ee4e-4831-ac6a-3d52d0f49fe0 req-275137b2-897b-40c1-ad86-e54e29280660 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028553 May 31 21:17:18.445962 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 571/1163] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:17:18.704929 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-d4bd0178-7029-4615-ac10-0be006b276e8 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:17:18.705583 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-d4bd0178-7029-4615-ac10-0be006b276e8 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] [instance: 5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:17:18.713289 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d4bd0178-7029-4615-ac10-0be006b276e8 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:18.713738 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d4bd0178-7029-4615-ac10-0be006b276e8 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:18.717206 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d4bd0178-7029-4615-ac10-0be006b276e8 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:18.717206 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d4bd0178-7029-4615-ac10-0be006b276e8 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:18.731359 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-d0b7ac2a-8c4f-4134-9819-a68bf57c3951 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:17:18.732053 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-d0b7ac2a-8c4f-4134-9819-a68bf57c3951 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 48d80d94-ed1f-4792-955f-5ac166350cb8] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:17:18.739327 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-d0b7ac2a-8c4f-4134-9819-a68bf57c3951 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:18.739793 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-d0b7ac2a-8c4f-4134-9819-a68bf57c3951 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:18.740586 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-d0b7ac2a-8c4f-4134-9819-a68bf57c3951 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:18.741258 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-d0b7ac2a-8c4f-4134-9819-a68bf57c3951 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:18.833421 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-d0b7ac2a-8c4f-4134-9819-a68bf57c3951 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546cd066c4244bffacbfea21f5e4f437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e511490c0f8438fb89ac590bd63529f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:17:18.841866 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-d0b7ac2a-8c4f-4134-9819-a68bf57c3951 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/48d80d94-ed1f-4792-955f-5ac166350cb8" status: 200 len: 1226 microversion: 2.1 time: 0.115175 May 31 21:17:18.842714 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 572/1164] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:17:18 2022] GET /compute/v2.1/servers/48d80d94-ed1f-4792-955f-5ac166350cb8 => generated 1226 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:17:18.897132 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-d4bd0178-7029-4615-ac10-0be006b276e8 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19f6c089e7ec4ca5914d760e742d89b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329e95cbfdb9493d82941bc00dd1ccbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:17:18.905555 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-d4bd0178-7029-4615-ac10-0be006b276e8 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] 10.222.0.55 "GET /compute/v2.1/servers/5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf" status: 200 len: 1318 microversion: 2.1 time: 0.204840 May 31 21:17:18.906162 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 593/1165] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:17:18 2022] GET /compute/v2.1/servers/5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf => generated 1318 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:17:19.213011 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [req-a1687e50-3317-43e9-b05b-4e5b97c853da req-e1d3a60d-47ae-499a-964d-23f1c4eaab3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf", "name": "network-vif-plugged", "status": "completed", "tag": "547f16e2-0ced-4efc-8ab6-8cdc9c735022"}]} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:17:19.221280 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-a1687e50-3317-43e9-b05b-4e5b97c853da req-e1d3a60d-47ae-499a-964d-23f1c4eaab3b service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:19.221720 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-a1687e50-3317-43e9-b05b-4e5b97c853da req-e1d3a60d-47ae-499a-964d-23f1c4eaab3b service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:19.233568 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.compute.server_external_events [req-a1687e50-3317-43e9-b05b-4e5b97c853da req-e1d3a60d-47ae-499a-964d-23f1c4eaab3b service nova] Creating event network-vif-plugged:547f16e2-0ced-4efc-8ab6-8cdc9c735022 for instance 5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf on hv-cinder-83979 May 31 21:17:19.238779 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [req-a1687e50-3317-43e9-b05b-4e5b97c853da req-e1d3a60d-47ae-499a-964d-23f1c4eaab3b service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029529 May 31 21:17:19.239358 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 573/1166] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:17:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:17:19.859164 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-732ad1c9-8a6e-4c8b-b938-a0ebae56f3d7 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:17:19.859775 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-732ad1c9-8a6e-4c8b-b938-a0ebae56f3d7 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 48d80d94-ed1f-4792-955f-5ac166350cb8] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:17:19.861699 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell0:SELECT=2 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:17:19.862487 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell0:SELECT=6 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:17:19.867645 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-732ad1c9-8a6e-4c8b-b938-a0ebae56f3d7 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:19.868095 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-732ad1c9-8a6e-4c8b-b938-a0ebae56f3d7 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:19.868856 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-732ad1c9-8a6e-4c8b-b938-a0ebae56f3d7 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:19.869343 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-732ad1c9-8a6e-4c8b-b938-a0ebae56f3d7 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:19.882677 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.wsgi [None req-732ad1c9-8a6e-4c8b-b938-a0ebae56f3d7 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] HTTP exception thrown: Instance 48d80d94-ed1f-4792-955f-5ac166350cb8 could not be found. May 31 21:17:19.884297 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-732ad1c9-8a6e-4c8b-b938-a0ebae56f3d7 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Request method failure captured: May 31 21:17:19.884297 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: request: GET /compute/v2.1/servers/48d80d94-ed1f-4792-955f-5ac166350cb8 HTTP/1.1 May 31 21:17:19.884297 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Accept: application/json May 31 21:17:19.884297 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Accept-Encoding: identity May 31 21:17:19.884297 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Connection: close May 31 21:17:19.884297 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Content-Length: 0 May 31 21:17:19.884297 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Content-Type: application/json May 31 21:17:19.884297 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Host: 10.222.0.55 May 31 21:17:19.884297 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Openstack-System-Scope: None May 31 21:17:19.884297 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: User-Agent: python-urllib3/1.26.9 May 31 21:17:19.884297 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Auth-Token: gAAAAABiloOgTfUO-lc7nDbKdfWKqO62bw1HfA7dgbwFJLheVHCZ2y6EF_fvHD4X3sHUmdUzsBqmSOFIsvCVJUmPvIr-lVLeVzFeCCM4eyesBpMRiqru6yEXb3xLsTUiiV10djblIsjlqlgif1nnW_lIm6b4EE-6k61w7JcDt3BQ6dUVTmkqiv8 May 31 21:17:19.884297 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Domain-Id: None May 31 21:17:19.884297 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Domain-Name: None May 31 21:17:19.884297 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Identity-Status: Confirmed May 31 21:17:19.884297 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Is-Admin-Project: True May 31 21:17:19.884297 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Domain-Id: default May 31 21:17:19.884297 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Domain-Name: Default May 31 21:17:19.884297 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Id: 8e511490c0f8438fb89ac590bd63529f May 31 21:17:19.884297 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Name: tempest-TestVolumeBootPattern-1802532727 May 31 21:17:19.884297 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Role: member,reader May 31 21:17:19.884297 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Roles: member,reader May 31 21:17:19.886068 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/8e511490c0f8438fb89ac590bd63529f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/8e511490c0f8438fb89ac590bd63529f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_8e511490c0f8438fb89ac590bd63529f", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/8e511490c0f8438fb89ac590bd63529f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] May 31 21:17:19.886068 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant: tempest-TestVolumeBootPattern-1802532727 May 31 21:17:19.886068 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant-Id: 8e511490c0f8438fb89ac590bd63529f May 31 21:17:19.886068 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant-Name: tempest-TestVolumeBootPattern-1802532727 May 31 21:17:19.886068 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User: tempest-TestVolumeBootPattern-1802532727-project May 31 21:17:19.886068 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Domain-Id: default May 31 21:17:19.886068 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Domain-Name: Default May 31 21:17:19.886068 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Id: 546cd066c4244bffacbfea21f5e4f437 May 31 21:17:19.886068 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Name: tempest-TestVolumeBootPattern-1802532727-project May 31 21:17:19.886068 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: method: > May 31 21:17:19.886068 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: exception: Instance 48d80d94-ed1f-4792-955f-5ac166350cb8 could not be found. May 31 21:17:19.886068 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: action_args: {'id': '48d80d94-ed1f-4792-955f-5ac166350cb8'} May 31 21:17:19.886939 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 21:17:19.886939 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:17:19.886939 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 21:17:19.886939 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 21:17:19.886939 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 21:17:19.886939 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 21:17:19.886939 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 21:17:19.886939 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 21:17:19.886939 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 21:17:19.886939 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 21:17:19.886939 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48d80d94-ed1f-4792-955f-5ac166350cb8 could not be found. May 31 21:17:19.886939 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:17:19.886939 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:17:19.886939 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:17:19.886939 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:17:19.886939 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:17:19.886939 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:17:19.886939 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 21:17:19.886939 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 21:17:19.886939 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 21:17:19.888234 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 21:17:19.888234 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 21:17:19.888234 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 21:17:19.888234 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 21:17:19.888234 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 21:17:19.888234 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 21:17:19.888234 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 21:17:19.888234 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48d80d94-ed1f-4792-955f-5ac166350cb8 could not be found. May 31 21:17:19.888234 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:17:19.888234 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:17:19.888234 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:17:19.888234 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:17:19.888234 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:17:19.888234 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:17:19.888234 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 21:17:19.888234 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 21:17:19.888234 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48d80d94-ed1f-4792-955f-5ac166350cb8 could not be found. May 31 21:17:19.888234 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:17:19.889493 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-732ad1c9-8a6e-4c8b-b938-a0ebae56f3d7 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Returning 404 to user: Instance 48d80d94-ed1f-4792-955f-5ac166350cb8 could not be found. {{(pid=118184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 21:17:19.889493 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-732ad1c9-8a6e-4c8b-b938-a0ebae56f3d7 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/48d80d94-ed1f-4792-955f-5ac166350cb8" status: 404 len: 111 microversion: 2.1 time: 0.030578 May 31 21:17:19.889493 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 594/1167] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:17:19 2022] GET /compute/v2.1/servers/48d80d94-ed1f-4792-955f-5ac166350cb8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 21:17:19.923074 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-9bae8486-b9ca-4832-9c75-e23df739ff21 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:17:19.924397 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-9bae8486-b9ca-4832-9c75-e23df739ff21 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] [instance: 5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:17:19.925800 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell0:SELECT=2 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:17:19.931785 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9bae8486-b9ca-4832-9c75-e23df739ff21 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:19.932288 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9bae8486-b9ca-4832-9c75-e23df739ff21 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:19.933065 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9bae8486-b9ca-4832-9c75-e23df739ff21 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:19.933511 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9bae8486-b9ca-4832-9c75-e23df739ff21 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:20.152116 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-9bae8486-b9ca-4832-9c75-e23df739ff21 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19f6c089e7ec4ca5914d760e742d89b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329e95cbfdb9493d82941bc00dd1ccbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:17:20.159568 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-9bae8486-b9ca-4832-9c75-e23df739ff21 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] 10.222.0.55 "GET /compute/v2.1/servers/5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf" status: 200 len: 1318 microversion: 2.1 time: 0.240784 May 31 21:17:20.160217 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 574/1168] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:17:19 2022] GET /compute/v2.1/servers/5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:17:20.472074 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-e58246ca-9d84-4c9d-bbe8-d44073c284f9 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:17:20.472573 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-e58246ca-9d84-4c9d-bbe8-d44073c284f9 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 92254a91-6b12-4811-a58e-e6f4cac9d965] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:17:20.479316 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e58246ca-9d84-4c9d-bbe8-d44073c284f9 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:20.479764 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e58246ca-9d84-4c9d-bbe8-d44073c284f9 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:20.480524 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e58246ca-9d84-4c9d-bbe8-d44073c284f9 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:20.480960 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e58246ca-9d84-4c9d-bbe8-d44073c284f9 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:20.495853 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.wsgi [None req-e58246ca-9d84-4c9d-bbe8-d44073c284f9 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] HTTP exception thrown: Instance 92254a91-6b12-4811-a58e-e6f4cac9d965 could not be found. May 31 21:17:20.497411 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-e58246ca-9d84-4c9d-bbe8-d44073c284f9 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Request method failure captured: May 31 21:17:20.497411 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: request: DELETE /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965 HTTP/1.1 May 31 21:17:20.497411 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Accept: application/json May 31 21:17:20.497411 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Accept-Encoding: identity May 31 21:17:20.497411 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Connection: close May 31 21:17:20.497411 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Content-Length: 0 May 31 21:17:20.497411 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Content-Type: application/json May 31 21:17:20.497411 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Host: 10.222.0.55 May 31 21:17:20.497411 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Openstack-System-Scope: None May 31 21:17:20.497411 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: User-Agent: python-urllib3/1.26.9 May 31 21:17:20.497411 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Auth-Token: gAAAAABiloOgTfUO-lc7nDbKdfWKqO62bw1HfA7dgbwFJLheVHCZ2y6EF_fvHD4X3sHUmdUzsBqmSOFIsvCVJUmPvIr-lVLeVzFeCCM4eyesBpMRiqru6yEXb3xLsTUiiV10djblIsjlqlgif1nnW_lIm6b4EE-6k61w7JcDt3BQ6dUVTmkqiv8 May 31 21:17:20.497411 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Domain-Id: None May 31 21:17:20.497411 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Domain-Name: None May 31 21:17:20.497411 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Identity-Status: Confirmed May 31 21:17:20.497411 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Is-Admin-Project: True May 31 21:17:20.497411 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Domain-Id: default May 31 21:17:20.497411 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Domain-Name: Default May 31 21:17:20.497411 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Id: 8e511490c0f8438fb89ac590bd63529f May 31 21:17:20.497411 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Name: tempest-TestVolumeBootPattern-1802532727 May 31 21:17:20.497411 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Role: member,reader May 31 21:17:20.497411 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Roles: member,reader May 31 21:17:20.499054 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/8e511490c0f8438fb89ac590bd63529f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/8e511490c0f8438fb89ac590bd63529f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_8e511490c0f8438fb89ac590bd63529f", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/8e511490c0f8438fb89ac590bd63529f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] May 31 21:17:20.499054 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant: tempest-TestVolumeBootPattern-1802532727 May 31 21:17:20.499054 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant-Id: 8e511490c0f8438fb89ac590bd63529f May 31 21:17:20.499054 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant-Name: tempest-TestVolumeBootPattern-1802532727 May 31 21:17:20.499054 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User: tempest-TestVolumeBootPattern-1802532727-project May 31 21:17:20.499054 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Domain-Id: default May 31 21:17:20.499054 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Domain-Name: Default May 31 21:17:20.499054 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Id: 546cd066c4244bffacbfea21f5e4f437 May 31 21:17:20.499054 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Name: tempest-TestVolumeBootPattern-1802532727-project May 31 21:17:20.499054 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: method: > May 31 21:17:20.499054 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: exception: Instance 92254a91-6b12-4811-a58e-e6f4cac9d965 could not be found. May 31 21:17:20.499054 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: action_args: {'id': '92254a91-6b12-4811-a58e-e6f4cac9d965'} May 31 21:17:20.499998 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 21:17:20.499998 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:17:20.499998 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 21:17:20.499998 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 21:17:20.499998 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 21:17:20.499998 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 21:17:20.499998 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 21:17:20.499998 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 21:17:20.499998 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 21:17:20.499998 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 21:17:20.499998 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92254a91-6b12-4811-a58e-e6f4cac9d965 could not be found. May 31 21:17:20.499998 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:17:20.499998 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:17:20.499998 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:17:20.499998 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:17:20.499998 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:17:20.499998 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:17:20.499998 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 21:17:20.499998 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 21:17:20.499998 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 21:17:20.501457 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 21:17:20.501457 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 31 21:17:20.501457 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 31 21:17:20.501457 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 31 21:17:20.501457 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 31 21:17:20.501457 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 21:17:20.501457 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 21:17:20.501457 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 21:17:20.501457 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 21:17:20.501457 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92254a91-6b12-4811-a58e-e6f4cac9d965 could not be found. May 31 21:17:20.501457 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:17:20.501457 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:17:20.501457 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:17:20.501457 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:17:20.501457 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:17:20.501457 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:17:20.501457 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 21:17:20.501457 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 21:17:20.501457 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92254a91-6b12-4811-a58e-e6f4cac9d965 could not be found. May 31 21:17:20.501457 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:17:20.502980 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-e58246ca-9d84-4c9d-bbe8-d44073c284f9 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Returning 404 to user: Instance 92254a91-6b12-4811-a58e-e6f4cac9d965 could not be found. {{(pid=118184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 21:17:20.502980 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-e58246ca-9d84-4c9d-bbe8-d44073c284f9 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "DELETE /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965" status: 404 len: 111 microversion: 2.1 time: 0.030972 May 31 21:17:20.502980 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 595/1169] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 31 21:17:20 2022] DELETE /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 21:17:20.507484 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-bb58148f-8a1a-43a3-9543-94f362a3dd60 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:17:20.508096 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-bb58148f-8a1a-43a3-9543-94f362a3dd60 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] [instance: 92254a91-6b12-4811-a58e-e6f4cac9d965] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:17:20.514952 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-bb58148f-8a1a-43a3-9543-94f362a3dd60 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:20.515404 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-bb58148f-8a1a-43a3-9543-94f362a3dd60 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:20.516180 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-bb58148f-8a1a-43a3-9543-94f362a3dd60 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:20.516618 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-bb58148f-8a1a-43a3-9543-94f362a3dd60 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:20.529954 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.wsgi [None req-bb58148f-8a1a-43a3-9543-94f362a3dd60 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] HTTP exception thrown: Instance 92254a91-6b12-4811-a58e-e6f4cac9d965 could not be found. May 31 21:17:20.531604 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-bb58148f-8a1a-43a3-9543-94f362a3dd60 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Request method failure captured: May 31 21:17:20.531604 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: request: GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965 HTTP/1.1 May 31 21:17:20.531604 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Accept: application/json May 31 21:17:20.531604 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Accept-Encoding: identity May 31 21:17:20.531604 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Connection: close May 31 21:17:20.531604 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Content-Length: 0 May 31 21:17:20.531604 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Content-Type: application/json May 31 21:17:20.531604 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Host: 10.222.0.55 May 31 21:17:20.531604 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Openstack-System-Scope: None May 31 21:17:20.531604 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: User-Agent: python-urllib3/1.26.9 May 31 21:17:20.531604 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Auth-Token: gAAAAABiloOgTfUO-lc7nDbKdfWKqO62bw1HfA7dgbwFJLheVHCZ2y6EF_fvHD4X3sHUmdUzsBqmSOFIsvCVJUmPvIr-lVLeVzFeCCM4eyesBpMRiqru6yEXb3xLsTUiiV10djblIsjlqlgif1nnW_lIm6b4EE-6k61w7JcDt3BQ6dUVTmkqiv8 May 31 21:17:20.531604 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Domain-Id: None May 31 21:17:20.531604 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Domain-Name: None May 31 21:17:20.531604 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Identity-Status: Confirmed May 31 21:17:20.531604 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Is-Admin-Project: True May 31 21:17:20.531604 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Domain-Id: default May 31 21:17:20.531604 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Domain-Name: Default May 31 21:17:20.531604 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Id: 8e511490c0f8438fb89ac590bd63529f May 31 21:17:20.531604 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Name: tempest-TestVolumeBootPattern-1802532727 May 31 21:17:20.531604 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Role: member,reader May 31 21:17:20.531604 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Roles: member,reader May 31 21:17:20.533226 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/8e511490c0f8438fb89ac590bd63529f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/8e511490c0f8438fb89ac590bd63529f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_8e511490c0f8438fb89ac590bd63529f", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/8e511490c0f8438fb89ac590bd63529f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] May 31 21:17:20.533226 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant: tempest-TestVolumeBootPattern-1802532727 May 31 21:17:20.533226 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant-Id: 8e511490c0f8438fb89ac590bd63529f May 31 21:17:20.533226 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant-Name: tempest-TestVolumeBootPattern-1802532727 May 31 21:17:20.533226 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User: tempest-TestVolumeBootPattern-1802532727-project May 31 21:17:20.533226 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Domain-Id: default May 31 21:17:20.533226 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Domain-Name: Default May 31 21:17:20.533226 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Id: 546cd066c4244bffacbfea21f5e4f437 May 31 21:17:20.533226 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Name: tempest-TestVolumeBootPattern-1802532727-project May 31 21:17:20.533226 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: method: > May 31 21:17:20.533226 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: exception: Instance 92254a91-6b12-4811-a58e-e6f4cac9d965 could not be found. May 31 21:17:20.533226 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: action_args: {'id': '92254a91-6b12-4811-a58e-e6f4cac9d965'} May 31 21:17:20.534110 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 21:17:20.534110 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:17:20.534110 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 21:17:20.534110 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 21:17:20.534110 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 21:17:20.534110 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 21:17:20.534110 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 21:17:20.534110 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 21:17:20.534110 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 21:17:20.534110 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 21:17:20.534110 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92254a91-6b12-4811-a58e-e6f4cac9d965 could not be found. May 31 21:17:20.534110 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:17:20.534110 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:17:20.534110 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:17:20.534110 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:17:20.534110 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:17:20.534110 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:17:20.534110 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 21:17:20.534110 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 21:17:20.534110 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 21:17:20.535556 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 21:17:20.535556 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 21:17:20.535556 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 21:17:20.535556 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 21:17:20.535556 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 21:17:20.535556 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 21:17:20.535556 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 21:17:20.535556 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92254a91-6b12-4811-a58e-e6f4cac9d965 could not be found. May 31 21:17:20.535556 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:17:20.535556 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:17:20.535556 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:17:20.535556 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:17:20.535556 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:17:20.535556 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:17:20.535556 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 21:17:20.535556 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 21:17:20.535556 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92254a91-6b12-4811-a58e-e6f4cac9d965 could not be found. May 31 21:17:20.535556 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:17:20.536921 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-bb58148f-8a1a-43a3-9543-94f362a3dd60 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Returning 404 to user: Instance 92254a91-6b12-4811-a58e-e6f4cac9d965 could not be found. {{(pid=118185) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 21:17:20.536921 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-bb58148f-8a1a-43a3-9543-94f362a3dd60 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965" status: 404 len: 111 microversion: 2.1 time: 0.029342 May 31 21:17:20.536921 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 575/1170] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:17:20 2022] GET /compute/v2.1/servers/92254a91-6b12-4811-a58e-e6f4cac9d965 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 21:17:21.176890 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-5d7a5b80-313f-4b0c-9d6b-991a1c023446 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:17:21.177504 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-5d7a5b80-313f-4b0c-9d6b-991a1c023446 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] [instance: 5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:17:21.184088 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5d7a5b80-313f-4b0c-9d6b-991a1c023446 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:21.184544 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5d7a5b80-313f-4b0c-9d6b-991a1c023446 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:21.185318 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5d7a5b80-313f-4b0c-9d6b-991a1c023446 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:21.185757 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5d7a5b80-313f-4b0c-9d6b-991a1c023446 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:21.319829 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-5d7a5b80-313f-4b0c-9d6b-991a1c023446 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19f6c089e7ec4ca5914d760e742d89b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329e95cbfdb9493d82941bc00dd1ccbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:17:21.328347 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-5d7a5b80-313f-4b0c-9d6b-991a1c023446 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] 10.222.0.55 "GET /compute/v2.1/servers/5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf" status: 200 len: 1318 microversion: 2.1 time: 0.155617 May 31 21:17:21.328896 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 596/1171] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:17:21 2022] GET /compute/v2.1/servers/5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:17:22.015716 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-04053b7c-baf9-48fd-a2b6-6492527f2633 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] Calling method '.version_select at 0x7fe7c1014940>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:17:22.094861 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-04053b7c-baf9-48fd-a2b6-6492527f2633 tempest-TestVolumeBootPattern-1802532727 tempest-TestVolumeBootPattern-1802532727-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1276431592" status: 202 len: 0 microversion: 2.1 time: 0.082881 May 31 21:17:22.095755 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 576/1172] 10.222.0.55 () {58 vars in 1262 bytes} [Tue May 31 21:17:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1276431592 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 21:17:22.344689 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-e889a9e5-552f-4238-9f2a-cc057a985b5f tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:17:22.345238 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-e889a9e5-552f-4238-9f2a-cc057a985b5f tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] [instance: 5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:17:22.351593 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e889a9e5-552f-4238-9f2a-cc057a985b5f tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:22.352075 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e889a9e5-552f-4238-9f2a-cc057a985b5f tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:22.352844 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e889a9e5-552f-4238-9f2a-cc057a985b5f tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:22.353277 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e889a9e5-552f-4238-9f2a-cc057a985b5f tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:22.481380 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-e889a9e5-552f-4238-9f2a-cc057a985b5f tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19f6c089e7ec4ca5914d760e742d89b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329e95cbfdb9493d82941bc00dd1ccbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:17:22.488756 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-e889a9e5-552f-4238-9f2a-cc057a985b5f tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] 10.222.0.55 "GET /compute/v2.1/servers/5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf" status: 200 len: 1507 microversion: 2.1 time: 0.148040 May 31 21:17:22.489319 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 597/1173] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:17:22 2022] GET /compute/v2.1/servers/5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf => generated 1507 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:17:22.505945 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-fcee3d6a-8978-4fa4-a05a-6300d59ef28a tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "69d4f801-9562-48dd-9212-d67f34a74baf", "device": "/dev/sdb"}} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:17:22.507604 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-fcee3d6a-8978-4fa4-a05a-6300d59ef28a tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] [instance: 5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:17:22.514420 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-fcee3d6a-8978-4fa4-a05a-6300d59ef28a tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:22.515108 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-fcee3d6a-8978-4fa4-a05a-6300d59ef28a tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:22.515891 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-fcee3d6a-8978-4fa4-a05a-6300d59ef28a tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:22.516331 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-fcee3d6a-8978-4fa4-a05a-6300d59ef28a tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:22.535256 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:17:23.154902 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-fcee3d6a-8978-4fa4-a05a-6300d59ef28a tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] 10.222.0.55 "POST /compute/v2.1/servers/5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.652820 May 31 21:17:23.156238 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 577/1174] 10.222.0.55 () {60 vars in 1322 bytes} [Tue May 31 21:17:22 2022] POST /compute/v2.1/servers/5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf/os-volume_attachments => generated 194 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:17:46.263569 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-065e63df-c884-4b2a-8917-577538fff8c9 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:17:46.264067 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-065e63df-c884-4b2a-8917-577538fff8c9 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] [instance: 5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:17:46.266156 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:17:46.266811 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell1:SELECT=78 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:17:46.271532 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-065e63df-c884-4b2a-8917-577538fff8c9 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:46.271984 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-065e63df-c884-4b2a-8917-577538fff8c9 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:46.272746 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-065e63df-c884-4b2a-8917-577538fff8c9 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:46.273182 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-065e63df-c884-4b2a-8917-577538fff8c9 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:46.351296 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.objects.instance [None req-065e63df-c884-4b2a-8917-577538fff8c9 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lazy-loading 'services' on Instance uuid 5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf {{(pid=118184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 21:17:46.532785 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-065e63df-c884-4b2a-8917-577538fff8c9 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] 10.222.0.55 "DELETE /compute/v2.1/servers/5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf/os-volume_attachments/69d4f801-9562-48dd-9212-d67f34a74baf" status: 202 len: 0 microversion: 2.1 time: 0.272877 May 31 21:17:46.533310 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 598/1175] 10.222.0.55 () {58 vars in 1415 bytes} [Tue May 31 21:17:46 2022] DELETE /compute/v2.1/servers/5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf/os-volume_attachments/69d4f801-9562-48dd-9212-d67f34a74baf => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 21:17:47.638869 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:17:47.639644 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell1:SELECT=7,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:17:47.643660 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-1686ab83-e816-4e7f-b84e-fb69f769b262 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:17:47.644251 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-1686ab83-e816-4e7f-b84e-fb69f769b262 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] [instance: 5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:17:47.650832 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-1686ab83-e816-4e7f-b84e-fb69f769b262 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:47.654430 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-1686ab83-e816-4e7f-b84e-fb69f769b262 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:47.654430 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-1686ab83-e816-4e7f-b84e-fb69f769b262 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:47.654430 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-1686ab83-e816-4e7f-b84e-fb69f769b262 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:47.679137 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-1686ab83-e816-4e7f-b84e-fb69f769b262 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] [instance: 5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf] Going to try to terminate instance {{(pid=118185) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 21:17:47.984436 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-1686ab83-e816-4e7f-b84e-fb69f769b262 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] 10.222.0.55 "DELETE /compute/v2.1/servers/5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf" status: 204 len: 0 microversion: 2.1 time: 0.346868 May 31 21:17:47.985350 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 578/1176] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 31 21:17:47 2022] DELETE /compute/v2.1/servers/5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 31 21:17:47.994646 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-72aae88b-16d0-4792-ad88-af07814e3490 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:17:47.999411 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-72aae88b-16d0-4792-ad88-af07814e3490 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] [instance: 5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:17:48.001563 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-72aae88b-16d0-4792-ad88-af07814e3490 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:48.002047 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-72aae88b-16d0-4792-ad88-af07814e3490 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:48.002807 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-72aae88b-16d0-4792-ad88-af07814e3490 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:48.003241 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-72aae88b-16d0-4792-ad88-af07814e3490 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:48.136908 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-72aae88b-16d0-4792-ad88-af07814e3490 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19f6c089e7ec4ca5914d760e742d89b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329e95cbfdb9493d82941bc00dd1ccbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:17:48.144262 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-72aae88b-16d0-4792-ad88-af07814e3490 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] 10.222.0.55 "GET /compute/v2.1/servers/5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf" status: 200 len: 1513 microversion: 2.1 time: 0.154372 May 31 21:17:48.144848 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 599/1177] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:17:47 2022] GET /compute/v2.1/servers/5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:17:49.161733 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-fef10dab-7e21-4910-8dfb-1687db9abe9c tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:17:49.162451 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-fef10dab-7e21-4910-8dfb-1687db9abe9c tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] [instance: 5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:17:49.168889 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-fef10dab-7e21-4910-8dfb-1687db9abe9c tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:49.169337 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-fef10dab-7e21-4910-8dfb-1687db9abe9c tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:49.170128 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-fef10dab-7e21-4910-8dfb-1687db9abe9c tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:49.170561 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-fef10dab-7e21-4910-8dfb-1687db9abe9c tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:49.298636 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-fef10dab-7e21-4910-8dfb-1687db9abe9c tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19f6c089e7ec4ca5914d760e742d89b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329e95cbfdb9493d82941bc00dd1ccbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:17:49.306928 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-fef10dab-7e21-4910-8dfb-1687db9abe9c tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] 10.222.0.55 "GET /compute/v2.1/servers/5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf" status: 200 len: 1513 microversion: 2.1 time: 0.149412 May 31 21:17:49.307495 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 579/1178] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:17:49 2022] GET /compute/v2.1/servers/5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:17:50.327348 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-b903ca6a-22b3-4339-8bd7-376920cc90b7 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:17:50.328364 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-b903ca6a-22b3-4339-8bd7-376920cc90b7 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] [instance: 5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:17:50.336628 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b903ca6a-22b3-4339-8bd7-376920cc90b7 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:50.337019 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b903ca6a-22b3-4339-8bd7-376920cc90b7 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:50.337914 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b903ca6a-22b3-4339-8bd7-376920cc90b7 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:50.338557 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b903ca6a-22b3-4339-8bd7-376920cc90b7 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:50.398156 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [req-b9cd844e-fa6f-45bb-acb7-10847a509d7a req-6375f710-97b6-4b2b-8757-81d77fe6ee84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf", "name": "network-vif-deleted", "tag": "547f16e2-0ced-4efc-8ab6-8cdc9c735022"}]} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:17:50.404941 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-b903ca6a-22b3-4339-8bd7-376920cc90b7 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19f6c089e7ec4ca5914d760e742d89b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329e95cbfdb9493d82941bc00dd1ccbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:17:50.412907 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-b903ca6a-22b3-4339-8bd7-376920cc90b7 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] 10.222.0.55 "GET /compute/v2.1/servers/5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf" status: 200 len: 1471 microversion: 2.1 time: 0.089719 May 31 21:17:50.413379 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-b9cd844e-fa6f-45bb-acb7-10847a509d7a req-6375f710-97b6-4b2b-8757-81d77fe6ee84 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:50.413500 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 600/1179] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:17:50 2022] GET /compute/v2.1/servers/5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf => generated 1471 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:17:50.413928 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-b9cd844e-fa6f-45bb-acb7-10847a509d7a req-6375f710-97b6-4b2b-8757-81d77fe6ee84 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:50.425443 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.compute.server_external_events [req-b9cd844e-fa6f-45bb-acb7-10847a509d7a req-6375f710-97b6-4b2b-8757-81d77fe6ee84 service nova] Creating event network-vif-deleted:547f16e2-0ced-4efc-8ab6-8cdc9c735022 for instance 5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf on hv-cinder-83979 May 31 21:17:50.430216 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [req-b9cd844e-fa6f-45bb-acb7-10847a509d7a req-6375f710-97b6-4b2b-8757-81d77fe6ee84 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035824 May 31 21:17:50.430799 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 580/1180] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:17:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 21:17:51.430928 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-281a8314-5765-4da7-a686-f2719a17e4d8 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:17:51.431540 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-281a8314-5765-4da7-a686-f2719a17e4d8 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] [instance: 5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:17:51.438020 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-281a8314-5765-4da7-a686-f2719a17e4d8 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:51.438525 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-281a8314-5765-4da7-a686-f2719a17e4d8 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:51.439282 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-281a8314-5765-4da7-a686-f2719a17e4d8 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:17:51.439715 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-281a8314-5765-4da7-a686-f2719a17e4d8 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:17:51.453646 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.wsgi [None req-281a8314-5765-4da7-a686-f2719a17e4d8 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] HTTP exception thrown: Instance 5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf could not be found. May 31 21:17:51.455300 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-281a8314-5765-4da7-a686-f2719a17e4d8 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Request method failure captured: May 31 21:17:51.455300 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: request: GET /compute/v2.1/servers/5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf HTTP/1.1 May 31 21:17:51.455300 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Accept: application/json May 31 21:17:51.455300 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Accept-Encoding: identity May 31 21:17:51.455300 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Connection: close May 31 21:17:51.455300 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Content-Length: 0 May 31 21:17:51.455300 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Content-Type: application/json May 31 21:17:51.455300 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Host: 10.222.0.55 May 31 21:17:51.455300 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Openstack-System-Scope: None May 31 21:17:51.455300 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: User-Agent: python-urllib3/1.26.9 May 31 21:17:51.455300 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Auth-Token: gAAAAABiloVkHhi-QJtt66_5CZJxRlOhDICf0clSEP1r038DtEsEKOQIUVzRnMsfMCEwEM_ciQh_UgV1Sn7lMvI51zcb11O-O9eUxhJoOn1WxQPPkYzwguAKKI7Ef3IZffm-g9Q2APAKVDZpWyFNTrHs4SUoj30e9VXHmSGSLrSFAP7_rLKx2fg May 31 21:17:51.455300 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Domain-Id: None May 31 21:17:51.455300 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Domain-Name: None May 31 21:17:51.455300 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Identity-Status: Confirmed May 31 21:17:51.455300 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Is-Admin-Project: True May 31 21:17:51.455300 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Domain-Id: default May 31 21:17:51.455300 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Domain-Name: Default May 31 21:17:51.455300 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Id: 329e95cbfdb9493d82941bc00dd1ccbe May 31 21:17:51.455300 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1963511953 May 31 21:17:51.455300 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Role: member,reader May 31 21:17:51.455300 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Roles: member,reader May 31 21:17:51.456959 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/329e95cbfdb9493d82941bc00dd1ccbe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/329e95cbfdb9493d82941bc00dd1ccbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_329e95cbfdb9493d82941bc00dd1ccbe", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/329e95cbfdb9493d82941bc00dd1ccbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] May 31 21:17:51.456959 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant: tempest-VolumesSnapshotTestJSON-1963511953 May 31 21:17:51.456959 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant-Id: 329e95cbfdb9493d82941bc00dd1ccbe May 31 21:17:51.456959 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1963511953 May 31 21:17:51.456959 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User: tempest-VolumesSnapshotTestJSON-1963511953-project May 31 21:17:51.456959 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Domain-Id: default May 31 21:17:51.456959 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Domain-Name: Default May 31 21:17:51.456959 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Id: 19f6c089e7ec4ca5914d760e742d89b3 May 31 21:17:51.456959 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Name: tempest-VolumesSnapshotTestJSON-1963511953-project May 31 21:17:51.456959 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: method: > May 31 21:17:51.456959 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: exception: Instance 5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf could not be found. May 31 21:17:51.456959 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: action_args: {'id': '5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf'} May 31 21:17:51.457837 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 21:17:51.457837 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:17:51.457837 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 21:17:51.457837 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 21:17:51.457837 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 21:17:51.457837 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 21:17:51.457837 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 21:17:51.457837 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 21:17:51.457837 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 21:17:51.457837 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 21:17:51.457837 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf could not be found. May 31 21:17:51.457837 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:17:51.457837 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:17:51.457837 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:17:51.457837 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:17:51.457837 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:17:51.457837 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:17:51.457837 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 21:17:51.457837 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 21:17:51.457837 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 21:17:51.459182 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 21:17:51.459182 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 21:17:51.459182 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 21:17:51.459182 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 21:17:51.459182 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 21:17:51.459182 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 21:17:51.459182 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 21:17:51.459182 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf could not be found. May 31 21:17:51.459182 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:17:51.459182 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:17:51.459182 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:17:51.459182 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:17:51.459182 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:17:51.459182 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:17:51.459182 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 21:17:51.459182 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 21:17:51.459182 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf could not be found. May 31 21:17:51.459182 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:17:51.460348 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-281a8314-5765-4da7-a686-f2719a17e4d8 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] Returning 404 to user: Instance 5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf could not be found. {{(pid=118184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 21:17:51.460348 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-281a8314-5765-4da7-a686-f2719a17e4d8 tempest-VolumesSnapshotTestJSON-1963511953 tempest-VolumesSnapshotTestJSON-1963511953-project] 10.222.0.55 "GET /compute/v2.1/servers/5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf" status: 404 len: 111 microversion: 2.1 time: 0.030186 May 31 21:17:51.460348 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 601/1181] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:17:51 2022] GET /compute/v2.1/servers/5e9ee975-2c0c-40f1-89f7-bc1a8a7631cf => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 21:18:08.394894 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:18:08.395569 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:18:08.640738 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-74d0808c-dbe9-4e3e-bcd4-2099f3170b58 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:18:08.641331 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-74d0808c-dbe9-4e3e-bcd4-2099f3170b58 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: cd8f2486-d4cf-40d9-9a07-d12933c0923b] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:18:08.647611 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-74d0808c-dbe9-4e3e-bcd4-2099f3170b58 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:18:08.648518 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-74d0808c-dbe9-4e3e-bcd4-2099f3170b58 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:18:08.649290 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-74d0808c-dbe9-4e3e-bcd4-2099f3170b58 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:18:08.649733 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-74d0808c-dbe9-4e3e-bcd4-2099f3170b58 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:18:08.672618 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-74d0808c-dbe9-4e3e-bcd4-2099f3170b58 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/cd8f2486-d4cf-40d9-9a07-d12933c0923b/ips" status: 200 len: 149 microversion: 2.1 time: 0.279275 May 31 21:18:08.673177 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 581/1182] 10.222.0.55 () {58 vars in 1247 bytes} [Tue May 31 21:18:08 2022] GET /compute/v2.1/servers/cd8f2486-d4cf-40d9-9a07-d12933c0923b/ips => generated 149 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:18:10.230967 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-0b213a56-0203-4397-b646-c6e0e8cfc526 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5f351a0c-2fe1-4d06-8668-23b70e8b7f01"}} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:18:10.232093 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-0b213a56-0203-4397-b646-c6e0e8cfc526 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: cd8f2486-d4cf-40d9-9a07-d12933c0923b] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:18:10.234708 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_api:SELECT=8 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:18:10.235425 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:18:10.240080 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-0b213a56-0203-4397-b646-c6e0e8cfc526 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:18:10.240524 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-0b213a56-0203-4397-b646-c6e0e8cfc526 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:18:10.241288 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-0b213a56-0203-4397-b646-c6e0e8cfc526 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:18:10.242345 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-0b213a56-0203-4397-b646-c6e0e8cfc526 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:18:10.956518 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-0b213a56-0203-4397-b646-c6e0e8cfc526 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "POST /compute/v2.1/servers/cd8f2486-d4cf-40d9-9a07-d12933c0923b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.729222 May 31 21:18:10.957426 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 602/1183] 10.222.0.55 () {60 vars in 1322 bytes} [Tue May 31 21:18:10 2022] POST /compute/v2.1/servers/cd8f2486-d4cf-40d9-9a07-d12933c0923b/os-volume_attachments => generated 194 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:18:18.439195 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-a51d58dd-5398-49b1-a6ee-290af9f9806d tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5f351a0c-2fe1-4d06-8668-23b70e8b7f01"}} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:18:18.440456 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-a51d58dd-5398-49b1-a6ee-290af9f9806d tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: cd8f2486-d4cf-40d9-9a07-d12933c0923b] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:18:18.447773 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a51d58dd-5398-49b1-a6ee-290af9f9806d tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:18:18.448230 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a51d58dd-5398-49b1-a6ee-290af9f9806d tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:18:18.449255 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a51d58dd-5398-49b1-a6ee-290af9f9806d tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:18:18.449695 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a51d58dd-5398-49b1-a6ee-290af9f9806d tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:18:18.531773 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.wsgi [None req-a51d58dd-5398-49b1-a6ee-290af9f9806d tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] HTTP exception thrown: Invalid volume: volume 5f351a0c-2fe1-4d06-8668-23b70e8b7f01 is already attached to instances: cd8f2486-d4cf-40d9-9a07-d12933c0923b May 31 21:18:18.533617 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-a51d58dd-5398-49b1-a6ee-290af9f9806d tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Request method failure captured: May 31 21:18:18.533617 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: request: POST /compute/v2.1/servers/cd8f2486-d4cf-40d9-9a07-d12933c0923b/os-volume_attachments HTTP/1.1 May 31 21:18:18.533617 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Accept: application/json May 31 21:18:18.533617 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Accept-Encoding: identity May 31 21:18:18.533617 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Connection: close May 31 21:18:18.533617 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Content-Length: 74 May 31 21:18:18.533617 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Content-Type: application/json May 31 21:18:18.533617 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Host: 10.222.0.55 May 31 21:18:18.533617 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Openstack-System-Scope: None May 31 21:18:18.533617 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: User-Agent: python-urllib3/1.26.9 May 31 21:18:18.533617 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Auth-Token: gAAAAABiloR6qg65df265xnXkf0TY6yHSXRv8NS86FmUnFNzjk_pCIOLgrgfJbkxmZYFC66OdFLRA4PHOQ2UiyK6Br4eaixrZ-5NlYmO2AXCMbb_Qo66xtWpyddhdAMGxddxV67OHhRmLW9fy2wijnAPzU9Ur_Oi62eu23Z9lUdWg-uvkw7ldZA May 31 21:18:18.533617 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Domain-Id: None May 31 21:18:18.533617 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Domain-Name: None May 31 21:18:18.533617 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Identity-Status: Confirmed May 31 21:18:18.533617 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Is-Admin-Project: True May 31 21:18:18.533617 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Domain-Id: default May 31 21:18:18.533617 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Domain-Name: Default May 31 21:18:18.533617 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Id: 69b2364f40d14160adf0220d92adaad7 May 31 21:18:18.533617 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Name: tempest-AttachVolumeNegativeTest-14232740 May 31 21:18:18.533617 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Role: member,reader May 31 21:18:18.533617 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Roles: member,reader May 31 21:18:18.535087 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/69b2364f40d14160adf0220d92adaad7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/69b2364f40d14160adf0220d92adaad7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_69b2364f40d14160adf0220d92adaad7", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/69b2364f40d14160adf0220d92adaad7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] May 31 21:18:18.535087 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant: tempest-AttachVolumeNegativeTest-14232740 May 31 21:18:18.535087 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant-Id: 69b2364f40d14160adf0220d92adaad7 May 31 21:18:18.535087 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-14232740 May 31 21:18:18.535087 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User: tempest-AttachVolumeNegativeTest-14232740-project May 31 21:18:18.535087 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Domain-Id: default May 31 21:18:18.535087 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Domain-Name: Default May 31 21:18:18.535087 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Id: 8efe37a6d57b4775b4e47a295c3f5eee May 31 21:18:18.535087 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Name: tempest-AttachVolumeNegativeTest-14232740-project May 31 21:18:18.535087 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: May 31 21:18:18.535087 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: {"volumeAttachment": {"volumeId": "5f351a0c-2fe1-4d06-8668-23b70e8b7f01"}} May 31 21:18:18.535087 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: method: > May 31 21:18:18.535990 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: exception: Invalid volume: volume 5f351a0c-2fe1-4d06-8668-23b70e8b7f01 is already attached to instances: cd8f2486-d4cf-40d9-9a07-d12933c0923b May 31 21:18:18.535990 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: action_args: {'server_id': 'cd8f2486-d4cf-40d9-9a07-d12933c0923b', 'body': {'volumeAttachment': {'volumeId': '5f351a0c-2fe1-4d06-8668-23b70e8b7f01'}}} May 31 21:18:18.535990 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 21:18:18.535990 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:18:18.535990 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 31 21:18:18.535990 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 31 21:18:18.535990 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 31 21:18:18.535990 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 31 21:18:18.535990 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 31 21:18:18.535990 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 31 21:18:18.535990 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 31 21:18:18.535990 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 31 21:18:18.535990 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 31 21:18:18.535990 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 31 21:18:18.535990 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 5f351a0c-2fe1-4d06-8668-23b70e8b7f01 is already attached to instances: cd8f2486-d4cf-40d9-9a07-d12933c0923b May 31 21:18:18.535990 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:18:18.535990 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:18:18.535990 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:18:18.535990 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:18:18.537244 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:18:18.537244 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:18:18.537244 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 21:18:18.537244 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 21:18:18.537244 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 21:18:18.537244 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 21:18:18.537244 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 31 21:18:18.537244 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 31 21:18:18.537244 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 31 21:18:18.537244 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 31 21:18:18.537244 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 31 21:18:18.537244 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 31 21:18:18.537244 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 31 21:18:18.537244 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 31 21:18:18.537244 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 5f351a0c-2fe1-4d06-8668-23b70e8b7f01 is already attached to instances: cd8f2486-d4cf-40d9-9a07-d12933c0923b May 31 21:18:18.537244 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:18:18.537244 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:18:18.537244 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:18:18.537244 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:18:18.537244 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:18:18.538587 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:18:18.538587 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 21:18:18.538587 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 21:18:18.538587 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 5f351a0c-2fe1-4d06-8668-23b70e8b7f01 is already attached to instances: cd8f2486-d4cf-40d9-9a07-d12933c0923b May 31 21:18:18.538587 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:18:18.538587 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-a51d58dd-5398-49b1-a6ee-290af9f9806d tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Returning 400 to user: Invalid volume: volume 5f351a0c-2fe1-4d06-8668-23b70e8b7f01 is already attached to instances: cd8f2486-d4cf-40d9-9a07-d12933c0923b {{(pid=118185) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 21:18:18.538587 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-a51d58dd-5398-49b1-a6ee-290af9f9806d tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "POST /compute/v2.1/servers/cd8f2486-d4cf-40d9-9a07-d12933c0923b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099903 May 31 21:18:18.538587 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 582/1184] 10.222.0.55 () {60 vars in 1322 bytes} [Tue May 31 21:18:18 2022] POST /compute/v2.1/servers/cd8f2486-d4cf-40d9-9a07-d12933c0923b/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 31 21:18:18.598843 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-44e09dd5-ba6d-44a6-9d5d-9c7684e4e171 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:18:18.599433 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-44e09dd5-ba6d-44a6-9d5d-9c7684e4e171 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: cd8f2486-d4cf-40d9-9a07-d12933c0923b] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:18:18.605797 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-44e09dd5-ba6d-44a6-9d5d-9c7684e4e171 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:18:18.606282 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-44e09dd5-ba6d-44a6-9d5d-9c7684e4e171 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:18:18.607047 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-44e09dd5-ba6d-44a6-9d5d-9c7684e4e171 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:18:18.607488 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-44e09dd5-ba6d-44a6-9d5d-9c7684e4e171 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:18:18.686704 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.objects.instance [None req-44e09dd5-ba6d-44a6-9d5d-9c7684e4e171 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lazy-loading 'services' on Instance uuid cd8f2486-d4cf-40d9-9a07-d12933c0923b {{(pid=118184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 21:18:18.913330 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-44e09dd5-ba6d-44a6-9d5d-9c7684e4e171 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "DELETE /compute/v2.1/servers/cd8f2486-d4cf-40d9-9a07-d12933c0923b/os-volume_attachments/5f351a0c-2fe1-4d06-8668-23b70e8b7f01" status: 202 len: 0 microversion: 2.1 time: 0.319122 May 31 21:18:18.913943 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 603/1185] 10.222.0.55 () {58 vars in 1415 bytes} [Tue May 31 21:18:18 2022] DELETE /compute/v2.1/servers/cd8f2486-d4cf-40d9-9a07-d12933c0923b/os-volume_attachments/5f351a0c-2fe1-4d06-8668-23b70e8b7f01 => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 21:18:18.922425 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-9f749bcd-47b9-4aa9-b039-717ffd31e91e tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:18:18.923350 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-9f749bcd-47b9-4aa9-b039-717ffd31e91e tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: cd8f2486-d4cf-40d9-9a07-d12933c0923b] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:18:18.930663 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9f749bcd-47b9-4aa9-b039-717ffd31e91e tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:18:18.931110 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9f749bcd-47b9-4aa9-b039-717ffd31e91e tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:18:18.931879 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9f749bcd-47b9-4aa9-b039-717ffd31e91e tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:18:18.932311 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9f749bcd-47b9-4aa9-b039-717ffd31e91e tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:18:18.963526 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-9f749bcd-47b9-4aa9-b039-717ffd31e91e tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/cd8f2486-d4cf-40d9-9a07-d12933c0923b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043024 May 31 21:18:18.963526 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 583/1186] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 31 21:18:18 2022] GET /compute/v2.1/servers/cd8f2486-d4cf-40d9-9a07-d12933c0923b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:18:19.973755 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-eb5db328-a3e8-439b-a3d5-1a631e46592a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:18:19.974834 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-eb5db328-a3e8-439b-a3d5-1a631e46592a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: cd8f2486-d4cf-40d9-9a07-d12933c0923b] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:18:19.981044 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-eb5db328-a3e8-439b-a3d5-1a631e46592a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:18:19.981488 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-eb5db328-a3e8-439b-a3d5-1a631e46592a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:18:19.982286 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-eb5db328-a3e8-439b-a3d5-1a631e46592a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:18:19.982721 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-eb5db328-a3e8-439b-a3d5-1a631e46592a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:18:20.010910 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-eb5db328-a3e8-439b-a3d5-1a631e46592a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/cd8f2486-d4cf-40d9-9a07-d12933c0923b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042026 May 31 21:18:20.011447 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 604/1187] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 31 21:18:19 2022] GET /compute/v2.1/servers/cd8f2486-d4cf-40d9-9a07-d12933c0923b/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 31 21:18:20.068396 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-e0d27579-d4e9-4ac5-add0-6ffd9ff24f36 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:18:20.068905 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-e0d27579-d4e9-4ac5-add0-6ffd9ff24f36 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: cd8f2486-d4cf-40d9-9a07-d12933c0923b] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:18:20.076187 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e0d27579-d4e9-4ac5-add0-6ffd9ff24f36 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:18:20.078170 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e0d27579-d4e9-4ac5-add0-6ffd9ff24f36 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:18:20.078170 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e0d27579-d4e9-4ac5-add0-6ffd9ff24f36 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:18:20.078170 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e0d27579-d4e9-4ac5-add0-6ffd9ff24f36 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:18:20.102870 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-e0d27579-d4e9-4ac5-add0-6ffd9ff24f36 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: cd8f2486-d4cf-40d9-9a07-d12933c0923b] Going to try to terminate instance {{(pid=118185) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 21:18:20.457416 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-e0d27579-d4e9-4ac5-add0-6ffd9ff24f36 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "DELETE /compute/v2.1/servers/cd8f2486-d4cf-40d9-9a07-d12933c0923b" status: 204 len: 0 microversion: 2.1 time: 0.392605 May 31 21:18:20.458036 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 584/1188] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 31 21:18:20 2022] DELETE /compute/v2.1/servers/cd8f2486-d4cf-40d9-9a07-d12933c0923b => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 31 21:18:20.465935 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-3506bc5d-1b2b-4170-bb34-970d40dd0a1a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:18:20.470034 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-3506bc5d-1b2b-4170-bb34-970d40dd0a1a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: cd8f2486-d4cf-40d9-9a07-d12933c0923b] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:18:20.472683 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-3506bc5d-1b2b-4170-bb34-970d40dd0a1a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:18:20.473126 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-3506bc5d-1b2b-4170-bb34-970d40dd0a1a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:18:20.473876 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-3506bc5d-1b2b-4170-bb34-970d40dd0a1a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:18:20.474341 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-3506bc5d-1b2b-4170-bb34-970d40dd0a1a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:18:20.803886 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-3506bc5d-1b2b-4170-bb34-970d40dd0a1a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe37a6d57b4775b4e47a295c3f5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b2364f40d14160adf0220d92adaad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:18:20.812858 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-3506bc5d-1b2b-4170-bb34-970d40dd0a1a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/cd8f2486-d4cf-40d9-9a07-d12933c0923b" status: 200 len: 1681 microversion: 2.1 time: 0.350471 May 31 21:18:20.813433 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 605/1189] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:18:20 2022] GET /compute/v2.1/servers/cd8f2486-d4cf-40d9-9a07-d12933c0923b => generated 1681 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:18:21.830749 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-3edfbf95-d5f3-4fb7-ad05-1ef20cf242d0 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:18:21.831442 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-3edfbf95-d5f3-4fb7-ad05-1ef20cf242d0 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: cd8f2486-d4cf-40d9-9a07-d12933c0923b] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:18:21.837834 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-3edfbf95-d5f3-4fb7-ad05-1ef20cf242d0 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:18:21.838308 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-3edfbf95-d5f3-4fb7-ad05-1ef20cf242d0 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:18:21.839063 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-3edfbf95-d5f3-4fb7-ad05-1ef20cf242d0 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:18:21.839492 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-3edfbf95-d5f3-4fb7-ad05-1ef20cf242d0 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:18:22.034626 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-3edfbf95-d5f3-4fb7-ad05-1ef20cf242d0 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe37a6d57b4775b4e47a295c3f5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b2364f40d14160adf0220d92adaad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:18:22.042519 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-3edfbf95-d5f3-4fb7-ad05-1ef20cf242d0 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/cd8f2486-d4cf-40d9-9a07-d12933c0923b" status: 200 len: 1681 microversion: 2.1 time: 0.215942 May 31 21:18:22.043100 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 585/1190] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:18:21 2022] GET /compute/v2.1/servers/cd8f2486-d4cf-40d9-9a07-d12933c0923b => generated 1681 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:18:23.059145 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-5d89e959-c42b-47fc-9e46-14b07c4a17f9 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:18:23.059754 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-5d89e959-c42b-47fc-9e46-14b07c4a17f9 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: cd8f2486-d4cf-40d9-9a07-d12933c0923b] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:18:23.066747 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5d89e959-c42b-47fc-9e46-14b07c4a17f9 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:18:23.067203 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5d89e959-c42b-47fc-9e46-14b07c4a17f9 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:18:23.067977 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5d89e959-c42b-47fc-9e46-14b07c4a17f9 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:18:23.068415 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5d89e959-c42b-47fc-9e46-14b07c4a17f9 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:18:23.130765 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-5d89e959-c42b-47fc-9e46-14b07c4a17f9 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe37a6d57b4775b4e47a295c3f5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b2364f40d14160adf0220d92adaad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:18:23.139001 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-5d89e959-c42b-47fc-9e46-14b07c4a17f9 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/cd8f2486-d4cf-40d9-9a07-d12933c0923b" status: 200 len: 1613 microversion: 2.1 time: 0.083659 May 31 21:18:23.139816 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 606/1191] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:18:23 2022] GET /compute/v2.1/servers/cd8f2486-d4cf-40d9-9a07-d12933c0923b => generated 1613 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:18:23.205041 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [req-d3c9d6bf-7792-45b1-ae30-72b430da41c1 req-a8d970d3-c3c5-4ebc-bdc5-50ecdb28193c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd8f2486-d4cf-40d9-9a07-d12933c0923b", "name": "network-vif-deleted", "tag": "8d4969e6-911a-44ca-b161-644f80deb122"}]} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:18:23.214840 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-d3c9d6bf-7792-45b1-ae30-72b430da41c1 req-a8d970d3-c3c5-4ebc-bdc5-50ecdb28193c service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:18:23.215290 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-d3c9d6bf-7792-45b1-ae30-72b430da41c1 req-a8d970d3-c3c5-4ebc-bdc5-50ecdb28193c service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:18:23.226126 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.compute.server_external_events [req-d3c9d6bf-7792-45b1-ae30-72b430da41c1 req-a8d970d3-c3c5-4ebc-bdc5-50ecdb28193c service nova] Creating event network-vif-deleted:8d4969e6-911a-44ca-b161-644f80deb122 for instance cd8f2486-d4cf-40d9-9a07-d12933c0923b on hv-cinder-83979 May 31 21:18:23.230937 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [req-d3c9d6bf-7792-45b1-ae30-72b430da41c1 req-a8d970d3-c3c5-4ebc-bdc5-50ecdb28193c service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029586 May 31 21:18:23.231540 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 586/1192] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:18:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:18:24.156815 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-de2c3d7a-5047-4089-a73d-7baaf62792b8 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:18:24.157437 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-de2c3d7a-5047-4089-a73d-7baaf62792b8 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: cd8f2486-d4cf-40d9-9a07-d12933c0923b] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:18:24.164880 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-de2c3d7a-5047-4089-a73d-7baaf62792b8 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:18:24.167172 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-de2c3d7a-5047-4089-a73d-7baaf62792b8 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:18:24.167172 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-de2c3d7a-5047-4089-a73d-7baaf62792b8 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:18:24.167172 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-de2c3d7a-5047-4089-a73d-7baaf62792b8 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:18:24.179562 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.wsgi [None req-de2c3d7a-5047-4089-a73d-7baaf62792b8 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] HTTP exception thrown: Instance cd8f2486-d4cf-40d9-9a07-d12933c0923b could not be found. May 31 21:18:24.181187 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-de2c3d7a-5047-4089-a73d-7baaf62792b8 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Request method failure captured: May 31 21:18:24.181187 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: request: GET /compute/v2.1/servers/cd8f2486-d4cf-40d9-9a07-d12933c0923b HTTP/1.1 May 31 21:18:24.181187 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Accept: application/json May 31 21:18:24.181187 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Accept-Encoding: identity May 31 21:18:24.181187 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Connection: close May 31 21:18:24.181187 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Content-Length: 0 May 31 21:18:24.181187 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Content-Type: application/json May 31 21:18:24.181187 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Host: 10.222.0.55 May 31 21:18:24.181187 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Openstack-System-Scope: None May 31 21:18:24.181187 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: User-Agent: python-urllib3/1.26.9 May 31 21:18:24.181187 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Auth-Token: gAAAAABiloR6qg65df265xnXkf0TY6yHSXRv8NS86FmUnFNzjk_pCIOLgrgfJbkxmZYFC66OdFLRA4PHOQ2UiyK6Br4eaixrZ-5NlYmO2AXCMbb_Qo66xtWpyddhdAMGxddxV67OHhRmLW9fy2wijnAPzU9Ur_Oi62eu23Z9lUdWg-uvkw7ldZA May 31 21:18:24.181187 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Domain-Id: None May 31 21:18:24.181187 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Domain-Name: None May 31 21:18:24.181187 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Identity-Status: Confirmed May 31 21:18:24.181187 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Is-Admin-Project: True May 31 21:18:24.181187 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Domain-Id: default May 31 21:18:24.181187 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Domain-Name: Default May 31 21:18:24.181187 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Id: 69b2364f40d14160adf0220d92adaad7 May 31 21:18:24.181187 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Name: tempest-AttachVolumeNegativeTest-14232740 May 31 21:18:24.181187 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Role: member,reader May 31 21:18:24.181187 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Roles: member,reader May 31 21:18:24.182917 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/69b2364f40d14160adf0220d92adaad7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/69b2364f40d14160adf0220d92adaad7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_69b2364f40d14160adf0220d92adaad7", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/69b2364f40d14160adf0220d92adaad7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] May 31 21:18:24.182917 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant: tempest-AttachVolumeNegativeTest-14232740 May 31 21:18:24.182917 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant-Id: 69b2364f40d14160adf0220d92adaad7 May 31 21:18:24.182917 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-14232740 May 31 21:18:24.182917 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User: tempest-AttachVolumeNegativeTest-14232740-project May 31 21:18:24.182917 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Domain-Id: default May 31 21:18:24.182917 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Domain-Name: Default May 31 21:18:24.182917 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Id: 8efe37a6d57b4775b4e47a295c3f5eee May 31 21:18:24.182917 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Name: tempest-AttachVolumeNegativeTest-14232740-project May 31 21:18:24.182917 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: method: > May 31 21:18:24.182917 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: exception: Instance cd8f2486-d4cf-40d9-9a07-d12933c0923b could not be found. May 31 21:18:24.182917 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: action_args: {'id': 'cd8f2486-d4cf-40d9-9a07-d12933c0923b'} May 31 21:18:24.184101 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 21:18:24.184101 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:18:24.184101 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 21:18:24.184101 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 21:18:24.184101 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 21:18:24.184101 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 21:18:24.184101 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 21:18:24.184101 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 21:18:24.184101 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 21:18:24.184101 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 21:18:24.184101 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd8f2486-d4cf-40d9-9a07-d12933c0923b could not be found. May 31 21:18:24.184101 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:18:24.184101 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:18:24.184101 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:18:24.184101 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:18:24.184101 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:18:24.184101 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:18:24.184101 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 21:18:24.184101 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 21:18:24.184101 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 21:18:24.185491 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 21:18:24.185491 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 21:18:24.185491 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 21:18:24.185491 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 21:18:24.185491 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 21:18:24.185491 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 21:18:24.185491 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 21:18:24.185491 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd8f2486-d4cf-40d9-9a07-d12933c0923b could not be found. May 31 21:18:24.185491 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:18:24.185491 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:18:24.185491 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:18:24.185491 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:18:24.185491 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:18:24.185491 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:18:24.185491 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 21:18:24.185491 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 21:18:24.185491 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd8f2486-d4cf-40d9-9a07-d12933c0923b could not be found. May 31 21:18:24.185491 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:18:24.187065 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-de2c3d7a-5047-4089-a73d-7baaf62792b8 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Returning 404 to user: Instance cd8f2486-d4cf-40d9-9a07-d12933c0923b could not be found. {{(pid=118184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 21:18:24.187065 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-de2c3d7a-5047-4089-a73d-7baaf62792b8 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/cd8f2486-d4cf-40d9-9a07-d12933c0923b" status: 404 len: 111 microversion: 2.1 time: 0.029919 May 31 21:18:24.187065 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 607/1193] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:18:24 2022] GET /compute/v2.1/servers/cd8f2486-d4cf-40d9-9a07-d12933c0923b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 21:18:24.192070 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-e1069756-d5af-4f11-a503-03757e67c80a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '.version_select at 0x7fe7c19489d0>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:18:24.286846 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-e1069756-d5af-4f11-a503-03757e67c80a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-753023604" status: 202 len: 0 microversion: 2.1 time: 0.098800 May 31 21:18:24.287476 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 587/1194] 10.222.0.55 () {58 vars in 1217 bytes} [Tue May 31 21:18:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-753023604 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 21:18:25.012169 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-4a708ffd-7900-4d02-802d-ab256a93c8fd tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Action: 'create', calling method: .version_select at 0x7fe7c0f95ee0>, body: {"keypair": {"name": "tempest-keypair-1009125788", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZzx57Kn+Y85qIDG7q/fzcLaZpl3SDlBCMSYOY/iXnIywQHIsZfLok/JlFKlTjlh7+rCH3HW5B0/id4kecvEZqyHc5h9riJjoQGrSyjIqJ9AnnUBL3+IeVi50cc/0iA8w=="}} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:18:25.025948 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.quota [None req-4a708ffd-7900-4d02-802d-ab256a93c8fd tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Getting quotas for project 69b2364f40d14160adf0220d92adaad7. Resources: {'key_pairs'} {{(pid=118184) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 21:18:25.029955 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.quota [None req-4a708ffd-7900-4d02-802d-ab256a93c8fd tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Getting quotas for user 8efe37a6d57b4775b4e47a295c3f5eee and project 69b2364f40d14160adf0220d92adaad7. Resources: {'key_pairs'} {{(pid=118184) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 21:18:25.142505 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-4a708ffd-7900-4d02-802d-ab256a93c8fd tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.134456 May 31 21:18:25.143023 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 608/1195] 10.222.0.55 () {60 vars in 1158 bytes} [Tue May 31 21:18:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:18:27.574620 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-f7e8e31b-2aaf-430b-a485-031adc1d1825 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1507265889", "imageRef": "21b89996-9e87-489d-8891-305f6c3d905a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f9f27def-cef7-45b6-9a7b-b0c954078818"}], "security_groups": [{"name": "tempest-securitygroup--1720436855"}], "key_name": "tempest-keypair-1009125788", "user_data": "}} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:18:27.676016 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.network.neutron [None req-f7e8e31b-2aaf-430b-a485-031adc1d1825 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] validate_networks() for [('f9f27def-cef7-45b6-9a7b-b0c954078818', None, None, None, None, None)] {{(pid=118185) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 21:18:28.035203 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.virt.hardware [None req-f7e8e31b-2aaf-430b-a485-031adc1d1825 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Flavor limits 0:0:0 {{(pid=118185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 21:18:28.035633 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.virt.hardware [None req-f7e8e31b-2aaf-430b-a485-031adc1d1825 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Image limits 0:0:0 {{(pid=118185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 21:18:28.036111 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.virt.hardware [None req-f7e8e31b-2aaf-430b-a485-031adc1d1825 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Flavor pref 0:0:0 {{(pid=118185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 21:18:28.036582 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.virt.hardware [None req-f7e8e31b-2aaf-430b-a485-031adc1d1825 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Image pref 0:0:0 {{(pid=118185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 21:18:28.036998 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.virt.hardware [None req-f7e8e31b-2aaf-430b-a485-031adc1d1825 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 21:18:28.045736 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f7e8e31b-2aaf-430b-a485-031adc1d1825 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:18:28.046228 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f7e8e31b-2aaf-430b-a485-031adc1d1825 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:18:28.047037 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f7e8e31b-2aaf-430b-a485-031adc1d1825 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:18:28.047486 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f7e8e31b-2aaf-430b-a485-031adc1d1825 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:18:28.064154 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.quota [None req-f7e8e31b-2aaf-430b-a485-031adc1d1825 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Getting quotas for project 69b2364f40d14160adf0220d92adaad7. Resources: {'ram', 'cores', 'instances'} {{(pid=118185) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 21:18:28.068065 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.quota [None req-f7e8e31b-2aaf-430b-a485-031adc1d1825 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Getting quotas for user 8efe37a6d57b4775b4e47a295c3f5eee and project 69b2364f40d14160adf0220d92adaad7. Resources: {'ram', 'cores', 'instances'} {{(pid=118185) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 21:18:28.079861 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-f7e8e31b-2aaf-430b-a485-031adc1d1825 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Going to run 1 instances... {{(pid=118185) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 21:18:28.082204 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-f7e8e31b-2aaf-430b-a485-031adc1d1825 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 903d1b05-7ed1-4b57-9325-7671d72d4284] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='21b89996-9e87-489d-8891-305f6c3d905a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118185) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 21:18:28.228170 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-f7e8e31b-2aaf-430b-a485-031adc1d1825 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.658951 May 31 21:18:28.228826 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 588/1196] 10.222.0.55 () {60 vars in 1146 bytes} [Tue May 31 21:18:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 660 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 31 21:18:28.239228 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-8099a0c9-02f6-4da0-82ba-fd54ab136707 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:18:28.239838 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-8099a0c9-02f6-4da0-82ba-fd54ab136707 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 903d1b05-7ed1-4b57-9325-7671d72d4284] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:18:28.293184 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-8099a0c9-02f6-4da0-82ba-fd54ab136707 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe37a6d57b4775b4e47a295c3f5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b2364f40d14160adf0220d92adaad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:18:28.300044 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-8099a0c9-02f6-4da0-82ba-fd54ab136707 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/903d1b05-7ed1-4b57-9325-7671d72d4284" status: 200 len: 1242 microversion: 2.1 time: 0.065065 May 31 21:18:28.300674 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 609/1197] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:18:28 2022] GET /compute/v2.1/servers/903d1b05-7ed1-4b57-9325-7671d72d4284 => generated 1242 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:18:29.317959 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-eaf4dc0e-58a5-4f54-bd10-7119557ad283 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:18:29.318826 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-eaf4dc0e-58a5-4f54-bd10-7119557ad283 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 903d1b05-7ed1-4b57-9325-7671d72d4284] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:18:29.326688 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-eaf4dc0e-58a5-4f54-bd10-7119557ad283 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:18:29.327138 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-eaf4dc0e-58a5-4f54-bd10-7119557ad283 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:18:29.327919 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-eaf4dc0e-58a5-4f54-bd10-7119557ad283 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:18:29.328362 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-eaf4dc0e-58a5-4f54-bd10-7119557ad283 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:18:29.390654 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-eaf4dc0e-58a5-4f54-bd10-7119557ad283 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe37a6d57b4775b4e47a295c3f5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b2364f40d14160adf0220d92adaad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:18:29.398056 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-eaf4dc0e-58a5-4f54-bd10-7119557ad283 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/903d1b05-7ed1-4b57-9325-7671d72d4284" status: 200 len: 1238 microversion: 2.1 time: 0.084472 May 31 21:18:29.398626 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 589/1198] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:18:29 2022] GET /compute/v2.1/servers/903d1b05-7ed1-4b57-9325-7671d72d4284 => generated 1238 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:18:30.415183 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-eac6e5c1-9c7a-45d3-be46-6885e2704c4e tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:18:30.415789 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-eac6e5c1-9c7a-45d3-be46-6885e2704c4e tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 903d1b05-7ed1-4b57-9325-7671d72d4284] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:18:30.422237 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-eac6e5c1-9c7a-45d3-be46-6885e2704c4e tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:18:30.422682 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-eac6e5c1-9c7a-45d3-be46-6885e2704c4e tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:18:30.423665 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-eac6e5c1-9c7a-45d3-be46-6885e2704c4e tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:18:30.424123 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-eac6e5c1-9c7a-45d3-be46-6885e2704c4e tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:18:30.489874 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-eac6e5c1-9c7a-45d3-be46-6885e2704c4e tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe37a6d57b4775b4e47a295c3f5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b2364f40d14160adf0220d92adaad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:18:30.497719 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-eac6e5c1-9c7a-45d3-be46-6885e2704c4e tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/903d1b05-7ed1-4b57-9325-7671d72d4284" status: 200 len: 1300 microversion: 2.1 time: 0.086996 May 31 21:18:30.498314 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 610/1199] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:18:30 2022] GET /compute/v2.1/servers/903d1b05-7ed1-4b57-9325-7671d72d4284 => generated 1300 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:18:31.514449 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-b36945a7-d49f-4e85-beed-c91c7e66843d tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:18:31.515020 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-b36945a7-d49f-4e85-beed-c91c7e66843d tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 903d1b05-7ed1-4b57-9325-7671d72d4284] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:18:31.521549 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b36945a7-d49f-4e85-beed-c91c7e66843d tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:18:31.522038 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b36945a7-d49f-4e85-beed-c91c7e66843d tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:18:31.523495 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b36945a7-d49f-4e85-beed-c91c7e66843d tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:18:31.523942 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-b36945a7-d49f-4e85-beed-c91c7e66843d tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:18:31.661306 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-b36945a7-d49f-4e85-beed-c91c7e66843d tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe37a6d57b4775b4e47a295c3f5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b2364f40d14160adf0220d92adaad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:18:31.668927 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-b36945a7-d49f-4e85-beed-c91c7e66843d tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/903d1b05-7ed1-4b57-9325-7671d72d4284" status: 200 len: 1368 microversion: 2.1 time: 0.158519 May 31 21:18:31.677991 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 590/1200] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:18:31 2022] GET /compute/v2.1/servers/903d1b05-7ed1-4b57-9325-7671d72d4284 => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:18:31.993420 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [req-16f42326-cb2d-48fb-9d9b-e8e96aebf681 req-75a20d87-2c2c-412d-8d4c-f5be15eda062 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "903d1b05-7ed1-4b57-9325-7671d72d4284", "tag": "54a3d30c-a1ca-4282-8b04-891f97fda031"}]} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:18:32.002219 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-16f42326-cb2d-48fb-9d9b-e8e96aebf681 req-75a20d87-2c2c-412d-8d4c-f5be15eda062 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:18:32.002657 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-16f42326-cb2d-48fb-9d9b-e8e96aebf681 req-75a20d87-2c2c-412d-8d4c-f5be15eda062 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:18:32.014034 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.compute.server_external_events [req-16f42326-cb2d-48fb-9d9b-e8e96aebf681 req-75a20d87-2c2c-412d-8d4c-f5be15eda062 service nova] Creating event network-changed:54a3d30c-a1ca-4282-8b04-891f97fda031 for instance 903d1b05-7ed1-4b57-9325-7671d72d4284 on hv-cinder-83979 May 31 21:18:32.019404 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [req-16f42326-cb2d-48fb-9d9b-e8e96aebf681 req-75a20d87-2c2c-412d-8d4c-f5be15eda062 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030356 May 31 21:18:32.019998 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 611/1201] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:18:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:18:32.684614 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-d8fd5602-9fc3-4b1e-897f-9c70882dce63 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:18:32.685230 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-d8fd5602-9fc3-4b1e-897f-9c70882dce63 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 903d1b05-7ed1-4b57-9325-7671d72d4284] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:18:32.691655 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-d8fd5602-9fc3-4b1e-897f-9c70882dce63 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:18:32.692105 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-d8fd5602-9fc3-4b1e-897f-9c70882dce63 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:18:32.692869 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-d8fd5602-9fc3-4b1e-897f-9c70882dce63 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:18:32.693306 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-d8fd5602-9fc3-4b1e-897f-9c70882dce63 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:18:32.823959 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-d8fd5602-9fc3-4b1e-897f-9c70882dce63 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe37a6d57b4775b4e47a295c3f5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b2364f40d14160adf0220d92adaad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:18:32.831375 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-d8fd5602-9fc3-4b1e-897f-9c70882dce63 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/903d1b05-7ed1-4b57-9325-7671d72d4284" status: 200 len: 1368 microversion: 2.1 time: 0.150623 May 31 21:18:32.831874 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 591/1202] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:18:32 2022] GET /compute/v2.1/servers/903d1b05-7ed1-4b57-9325-7671d72d4284 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:18:33.849468 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-15a0106f-3761-4693-aca2-1eaca93e6024 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:18:33.850182 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-15a0106f-3761-4693-aca2-1eaca93e6024 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 903d1b05-7ed1-4b57-9325-7671d72d4284] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:18:33.856952 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-15a0106f-3761-4693-aca2-1eaca93e6024 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:18:33.857393 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-15a0106f-3761-4693-aca2-1eaca93e6024 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:18:33.858176 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-15a0106f-3761-4693-aca2-1eaca93e6024 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:18:33.858610 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-15a0106f-3761-4693-aca2-1eaca93e6024 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:18:33.986081 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-15a0106f-3761-4693-aca2-1eaca93e6024 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe37a6d57b4775b4e47a295c3f5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b2364f40d14160adf0220d92adaad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:18:33.993801 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-15a0106f-3761-4693-aca2-1eaca93e6024 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/903d1b05-7ed1-4b57-9325-7671d72d4284" status: 200 len: 1368 microversion: 2.1 time: 0.148598 May 31 21:18:33.994387 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 612/1203] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:18:33 2022] GET /compute/v2.1/servers/903d1b05-7ed1-4b57-9325-7671d72d4284 => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:18:35.010058 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-cd61957c-fde7-4d5f-855f-325f310dcb16 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:18:35.010704 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-cd61957c-fde7-4d5f-855f-325f310dcb16 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 903d1b05-7ed1-4b57-9325-7671d72d4284] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:18:35.016998 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-cd61957c-fde7-4d5f-855f-325f310dcb16 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:18:35.020325 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-cd61957c-fde7-4d5f-855f-325f310dcb16 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:18:35.020325 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-cd61957c-fde7-4d5f-855f-325f310dcb16 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:18:35.020325 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-cd61957c-fde7-4d5f-855f-325f310dcb16 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:18:35.146234 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-cd61957c-fde7-4d5f-855f-325f310dcb16 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe37a6d57b4775b4e47a295c3f5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b2364f40d14160adf0220d92adaad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:18:35.153598 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-cd61957c-fde7-4d5f-855f-325f310dcb16 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/903d1b05-7ed1-4b57-9325-7671d72d4284" status: 200 len: 1368 microversion: 2.1 time: 0.147366 May 31 21:18:35.154193 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 592/1204] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:18:35 2022] GET /compute/v2.1/servers/903d1b05-7ed1-4b57-9325-7671d72d4284 => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:18:36.170316 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-a12dd4ac-f2eb-42af-8d3d-0959201cf432 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:18:36.170866 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-a12dd4ac-f2eb-42af-8d3d-0959201cf432 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 903d1b05-7ed1-4b57-9325-7671d72d4284] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:18:36.177335 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a12dd4ac-f2eb-42af-8d3d-0959201cf432 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:18:36.177812 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a12dd4ac-f2eb-42af-8d3d-0959201cf432 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:18:36.178606 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a12dd4ac-f2eb-42af-8d3d-0959201cf432 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:18:36.179075 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a12dd4ac-f2eb-42af-8d3d-0959201cf432 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:18:36.307930 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-a12dd4ac-f2eb-42af-8d3d-0959201cf432 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe37a6d57b4775b4e47a295c3f5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b2364f40d14160adf0220d92adaad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:18:36.315425 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-a12dd4ac-f2eb-42af-8d3d-0959201cf432 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/903d1b05-7ed1-4b57-9325-7671d72d4284" status: 200 len: 1368 microversion: 2.1 time: 0.149098 May 31 21:18:36.315995 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 613/1205] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:18:36 2022] GET /compute/v2.1/servers/903d1b05-7ed1-4b57-9325-7671d72d4284 => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:18:37.332319 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-3c3e3941-c02c-4567-a698-79275c2f2ecd tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:18:37.332914 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-3c3e3941-c02c-4567-a698-79275c2f2ecd tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 903d1b05-7ed1-4b57-9325-7671d72d4284] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:18:37.339947 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-3c3e3941-c02c-4567-a698-79275c2f2ecd tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:18:37.340393 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-3c3e3941-c02c-4567-a698-79275c2f2ecd tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:18:37.341153 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-3c3e3941-c02c-4567-a698-79275c2f2ecd tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:18:37.341588 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-3c3e3941-c02c-4567-a698-79275c2f2ecd tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:18:37.472172 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-3c3e3941-c02c-4567-a698-79275c2f2ecd tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe37a6d57b4775b4e47a295c3f5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b2364f40d14160adf0220d92adaad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:18:37.479716 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-3c3e3941-c02c-4567-a698-79275c2f2ecd tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/903d1b05-7ed1-4b57-9325-7671d72d4284" status: 200 len: 1368 microversion: 2.1 time: 0.151217 May 31 21:18:37.480290 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 593/1206] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:18:37 2022] GET /compute/v2.1/servers/903d1b05-7ed1-4b57-9325-7671d72d4284 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:18:38.496217 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-bb16eec0-fabc-4fb6-b30a-3092365d07dd tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:18:38.496824 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-bb16eec0-fabc-4fb6-b30a-3092365d07dd tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 903d1b05-7ed1-4b57-9325-7671d72d4284] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:18:38.499237 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell0:SELECT=6 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:18:38.504047 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-bb16eec0-fabc-4fb6-b30a-3092365d07dd tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:18:38.504492 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-bb16eec0-fabc-4fb6-b30a-3092365d07dd tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:18:38.505298 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-bb16eec0-fabc-4fb6-b30a-3092365d07dd tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:18:38.505734 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-bb16eec0-fabc-4fb6-b30a-3092365d07dd tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:18:38.637227 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-bb16eec0-fabc-4fb6-b30a-3092365d07dd tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe37a6d57b4775b4e47a295c3f5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b2364f40d14160adf0220d92adaad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:18:38.644587 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-bb16eec0-fabc-4fb6-b30a-3092365d07dd tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/903d1b05-7ed1-4b57-9325-7671d72d4284" status: 200 len: 1368 microversion: 2.1 time: 0.152257 May 31 21:18:38.645178 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 614/1207] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:18:38 2022] GET /compute/v2.1/servers/903d1b05-7ed1-4b57-9325-7671d72d4284 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:18:39.603157 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [req-edab1917-5acc-483c-9ee2-01c88a93aa4c req-a407b180-e140-434a-908d-d578a3d41d12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "903d1b05-7ed1-4b57-9325-7671d72d4284", "name": "network-vif-plugged", "status": "completed", "tag": "54a3d30c-a1ca-4282-8b04-891f97fda031"}]} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:18:39.607860 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell0:SELECT=2 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:18:39.608517 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell0:SELECT=6 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:18:39.609590 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:18:39.613418 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-edab1917-5acc-483c-9ee2-01c88a93aa4c req-a407b180-e140-434a-908d-d578a3d41d12 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:18:39.627603 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-edab1917-5acc-483c-9ee2-01c88a93aa4c req-a407b180-e140-434a-908d-d578a3d41d12 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:18:39.627603 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:18:39.627603 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.compute.server_external_events [req-edab1917-5acc-483c-9ee2-01c88a93aa4c req-a407b180-e140-434a-908d-d578a3d41d12 service nova] Creating event network-vif-plugged:54a3d30c-a1ca-4282-8b04-891f97fda031 for instance 903d1b05-7ed1-4b57-9325-7671d72d4284 on hv-cinder-83979 May 31 21:18:39.629739 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [req-edab1917-5acc-483c-9ee2-01c88a93aa4c req-a407b180-e140-434a-908d-d578a3d41d12 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030257 May 31 21:18:39.630433 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 594/1208] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:18:39.662939 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-b566628c-040b-4bbd-a0f2-5e2cdba553da tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:18:39.664083 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-b566628c-040b-4bbd-a0f2-5e2cdba553da tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 903d1b05-7ed1-4b57-9325-7671d72d4284] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:18:39.672112 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b566628c-040b-4bbd-a0f2-5e2cdba553da tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:18:39.672557 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b566628c-040b-4bbd-a0f2-5e2cdba553da tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:18:39.673321 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b566628c-040b-4bbd-a0f2-5e2cdba553da tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:18:39.673750 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-b566628c-040b-4bbd-a0f2-5e2cdba553da tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:18:39.807755 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-b566628c-040b-4bbd-a0f2-5e2cdba553da tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe37a6d57b4775b4e47a295c3f5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b2364f40d14160adf0220d92adaad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:18:39.815271 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-b566628c-040b-4bbd-a0f2-5e2cdba553da tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/903d1b05-7ed1-4b57-9325-7671d72d4284" status: 200 len: 1368 microversion: 2.1 time: 0.157315 May 31 21:18:39.818018 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 615/1209] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:18:39 2022] GET /compute/v2.1/servers/903d1b05-7ed1-4b57-9325-7671d72d4284 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:18:40.834245 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-d9212822-29a9-417a-a054-58dd3e57a340 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:18:40.835459 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-d9212822-29a9-417a-a054-58dd3e57a340 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 903d1b05-7ed1-4b57-9325-7671d72d4284] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:18:40.843811 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-d9212822-29a9-417a-a054-58dd3e57a340 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:18:40.844267 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-d9212822-29a9-417a-a054-58dd3e57a340 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:18:40.845037 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-d9212822-29a9-417a-a054-58dd3e57a340 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:18:40.845480 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-d9212822-29a9-417a-a054-58dd3e57a340 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:18:40.973360 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-d9212822-29a9-417a-a054-58dd3e57a340 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe37a6d57b4775b4e47a295c3f5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b2364f40d14160adf0220d92adaad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:18:40.980791 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-d9212822-29a9-417a-a054-58dd3e57a340 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/903d1b05-7ed1-4b57-9325-7671d72d4284" status: 200 len: 1368 microversion: 2.1 time: 0.151579 May 31 21:18:40.981367 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 595/1210] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:18:40 2022] GET /compute/v2.1/servers/903d1b05-7ed1-4b57-9325-7671d72d4284 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:18:41.998406 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-8caf134c-f63f-4fea-800c-a3b6b0326d54 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:18:41.999048 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-8caf134c-f63f-4fea-800c-a3b6b0326d54 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 903d1b05-7ed1-4b57-9325-7671d72d4284] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:18:42.001401 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:18:42.006331 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-8caf134c-f63f-4fea-800c-a3b6b0326d54 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:18:42.006782 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-8caf134c-f63f-4fea-800c-a3b6b0326d54 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:18:42.007569 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-8caf134c-f63f-4fea-800c-a3b6b0326d54 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:18:42.008005 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-8caf134c-f63f-4fea-800c-a3b6b0326d54 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:18:42.010538 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:18:42.139496 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-8caf134c-f63f-4fea-800c-a3b6b0326d54 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe37a6d57b4775b4e47a295c3f5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b2364f40d14160adf0220d92adaad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:18:42.147111 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-8caf134c-f63f-4fea-800c-a3b6b0326d54 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/903d1b05-7ed1-4b57-9325-7671d72d4284" status: 200 len: 1557 microversion: 2.1 time: 0.152522 May 31 21:18:42.147867 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 616/1211] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:18:41 2022] GET /compute/v2.1/servers/903d1b05-7ed1-4b57-9325-7671d72d4284 => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:18:42.164878 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-2ca1ea1d-e792-42e2-af96-e4b3dfc27a1c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:18:42.165361 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-2ca1ea1d-e792-42e2-af96-e4b3dfc27a1c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 903d1b05-7ed1-4b57-9325-7671d72d4284] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:18:42.171950 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-2ca1ea1d-e792-42e2-af96-e4b3dfc27a1c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:18:42.172406 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-2ca1ea1d-e792-42e2-af96-e4b3dfc27a1c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:18:42.173173 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-2ca1ea1d-e792-42e2-af96-e4b3dfc27a1c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:18:42.173615 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-2ca1ea1d-e792-42e2-af96-e4b3dfc27a1c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:18:42.250205 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-2ca1ea1d-e792-42e2-af96-e4b3dfc27a1c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/903d1b05-7ed1-4b57-9325-7671d72d4284/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090232 May 31 21:18:42.250799 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 596/1212] 10.222.0.55 () {58 vars in 1274 bytes} [Tue May 31 21:18:42 2022] GET /compute/v2.1/servers/903d1b05-7ed1-4b57-9325-7671d72d4284/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:18:43.186726 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [req-17dcb558-a359-48cb-a1c1-1cb262167b49 req-3de381a3-ea7d-46ed-94c0-c89700ef1882 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "903d1b05-7ed1-4b57-9325-7671d72d4284", "tag": "54a3d30c-a1ca-4282-8b04-891f97fda031"}]} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:18:43.194763 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-17dcb558-a359-48cb-a1c1-1cb262167b49 req-3de381a3-ea7d-46ed-94c0-c89700ef1882 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:18:43.195269 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-17dcb558-a359-48cb-a1c1-1cb262167b49 req-3de381a3-ea7d-46ed-94c0-c89700ef1882 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:18:43.206235 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.compute.server_external_events [req-17dcb558-a359-48cb-a1c1-1cb262167b49 req-3de381a3-ea7d-46ed-94c0-c89700ef1882 service nova] Creating event network-changed:54a3d30c-a1ca-4282-8b04-891f97fda031 for instance 903d1b05-7ed1-4b57-9325-7671d72d4284 on hv-cinder-83979 May 31 21:18:43.211490 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [req-17dcb558-a359-48cb-a1c1-1cb262167b49 req-3de381a3-ea7d-46ed-94c0-c89700ef1882 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028300 May 31 21:18:43.211994 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 617/1213] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:18:59.158709 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_api:SELECT=5 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:18:59.159383 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell1:SELECT=11 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:18:59.163773 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-e5146c16-25b5-46f7-b0b8-e99655038722 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:18:59.164301 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-e5146c16-25b5-46f7-b0b8-e99655038722 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] [instance: 45453898-e1e4-44bb-8af5-3a1729aa2870] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:18:59.170183 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e5146c16-25b5-46f7-b0b8-e99655038722 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:18:59.170636 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e5146c16-25b5-46f7-b0b8-e99655038722 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:18:59.171399 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e5146c16-25b5-46f7-b0b8-e99655038722 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:18:59.171836 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e5146c16-25b5-46f7-b0b8-e99655038722 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:18:59.194359 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.objects.instance [None req-e5146c16-25b5-46f7-b0b8-e99655038722 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lazy-loading 'flavor' on Instance uuid 45453898-e1e4-44bb-8af5-3a1729aa2870 {{(pid=118185) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 21:18:59.578979 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-e5146c16-25b5-46f7-b0b8-e99655038722 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] 10.222.0.55 "POST /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870/action" status: 202 len: 0 microversion: 2.1 time: 0.421556 May 31 21:18:59.579601 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 597/1214] 10.222.0.55 () {60 vars in 1277 bytes} [Tue May 31 21:18:59 2022] POST /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870/action => generated 0 bytes in 423 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 21:18:59.586234 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_api:SELECT=3 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:18:59.586987 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell1:SELECT=7 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:18:59.591110 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-3efdec72-fb59-4e09-a86f-aa5726181c45 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:18:59.593848 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-3efdec72-fb59-4e09-a86f-aa5726181c45 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] [instance: 45453898-e1e4-44bb-8af5-3a1729aa2870] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:18:59.597753 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-3efdec72-fb59-4e09-a86f-aa5726181c45 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:18:59.598930 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-3efdec72-fb59-4e09-a86f-aa5726181c45 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:18:59.599738 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-3efdec72-fb59-4e09-a86f-aa5726181c45 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:18:59.600212 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-3efdec72-fb59-4e09-a86f-aa5726181c45 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:18:59.734515 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-3efdec72-fb59-4e09-a86f-aa5726181c45 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782845f8e6a440b684ae46a6ed118a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c46b1e7a32484b9c22387f2aaeb871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:18:59.741986 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-3efdec72-fb59-4e09-a86f-aa5726181c45 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] 10.222.0.55 "GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870" status: 200 len: 1570 microversion: 2.1 time: 0.157807 May 31 21:18:59.742550 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 618/1215] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:18:59 2022] GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870 => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:19:00.759946 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-79d63a62-7675-44c3-a183-a5d552762960 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:19:00.760645 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-79d63a62-7675-44c3-a183-a5d552762960 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] [instance: 45453898-e1e4-44bb-8af5-3a1729aa2870] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:19:00.766862 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-79d63a62-7675-44c3-a183-a5d552762960 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:00.767313 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-79d63a62-7675-44c3-a183-a5d552762960 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:00.768080 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-79d63a62-7675-44c3-a183-a5d552762960 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:00.768517 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-79d63a62-7675-44c3-a183-a5d552762960 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:00.898693 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-79d63a62-7675-44c3-a183-a5d552762960 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782845f8e6a440b684ae46a6ed118a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c46b1e7a32484b9c22387f2aaeb871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:19:00.906341 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-79d63a62-7675-44c3-a183-a5d552762960 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] 10.222.0.55 "GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870" status: 200 len: 1570 microversion: 2.1 time: 0.151053 May 31 21:19:00.906915 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 598/1216] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:19:00 2022] GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 21:19:01.924037 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-1213d621-730c-4c13-b7c4-48166d167ca1 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:19:01.924639 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-1213d621-730c-4c13-b7c4-48166d167ca1 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] [instance: 45453898-e1e4-44bb-8af5-3a1729aa2870] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:19:01.931112 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-1213d621-730c-4c13-b7c4-48166d167ca1 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:01.931550 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-1213d621-730c-4c13-b7c4-48166d167ca1 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:01.932299 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-1213d621-730c-4c13-b7c4-48166d167ca1 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:01.932728 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-1213d621-730c-4c13-b7c4-48166d167ca1 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:02.059930 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-1213d621-730c-4c13-b7c4-48166d167ca1 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782845f8e6a440b684ae46a6ed118a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c46b1e7a32484b9c22387f2aaeb871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:19:02.067420 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-1213d621-730c-4c13-b7c4-48166d167ca1 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] 10.222.0.55 "GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870" status: 200 len: 1570 microversion: 2.1 time: 0.147206 May 31 21:19:02.067979 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 619/1217] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:19:01 2022] GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870 => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:19:03.085557 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-057637d9-399c-4fac-9736-eb3af92589de tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:19:03.086159 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-057637d9-399c-4fac-9736-eb3af92589de tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] [instance: 45453898-e1e4-44bb-8af5-3a1729aa2870] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:19:03.092510 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-057637d9-399c-4fac-9736-eb3af92589de tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:03.092953 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-057637d9-399c-4fac-9736-eb3af92589de tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:03.093711 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-057637d9-399c-4fac-9736-eb3af92589de tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:03.094170 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-057637d9-399c-4fac-9736-eb3af92589de tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:03.231095 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-057637d9-399c-4fac-9736-eb3af92589de tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782845f8e6a440b684ae46a6ed118a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c46b1e7a32484b9c22387f2aaeb871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:19:03.238577 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-057637d9-399c-4fac-9736-eb3af92589de tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] 10.222.0.55 "GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870" status: 200 len: 1570 microversion: 2.1 time: 0.157469 May 31 21:19:03.239142 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 599/1218] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:19:03 2022] GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870 => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:19:04.255500 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-6f06de07-10ba-419d-bea1-29cc631c0567 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:19:04.256114 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-6f06de07-10ba-419d-bea1-29cc631c0567 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] [instance: 45453898-e1e4-44bb-8af5-3a1729aa2870] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:19:04.263080 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6f06de07-10ba-419d-bea1-29cc631c0567 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:04.263534 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6f06de07-10ba-419d-bea1-29cc631c0567 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:04.264326 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6f06de07-10ba-419d-bea1-29cc631c0567 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:04.264767 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6f06de07-10ba-419d-bea1-29cc631c0567 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:04.394529 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-6f06de07-10ba-419d-bea1-29cc631c0567 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782845f8e6a440b684ae46a6ed118a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c46b1e7a32484b9c22387f2aaeb871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:19:04.402658 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-6f06de07-10ba-419d-bea1-29cc631c0567 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] 10.222.0.55 "GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870" status: 200 len: 1570 microversion: 2.1 time: 0.151112 May 31 21:19:04.403232 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 620/1219] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:19:04 2022] GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:19:05.419748 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-63064dc1-6738-4bcf-b15f-3c915a400580 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:19:05.420359 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-63064dc1-6738-4bcf-b15f-3c915a400580 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] [instance: 45453898-e1e4-44bb-8af5-3a1729aa2870] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:19:05.426768 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-63064dc1-6738-4bcf-b15f-3c915a400580 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:05.427217 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-63064dc1-6738-4bcf-b15f-3c915a400580 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:05.427978 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-63064dc1-6738-4bcf-b15f-3c915a400580 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:05.428420 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-63064dc1-6738-4bcf-b15f-3c915a400580 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:05.560103 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-63064dc1-6738-4bcf-b15f-3c915a400580 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782845f8e6a440b684ae46a6ed118a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c46b1e7a32484b9c22387f2aaeb871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:19:05.567433 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-63064dc1-6738-4bcf-b15f-3c915a400580 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] 10.222.0.55 "GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870" status: 200 len: 1570 microversion: 2.1 time: 0.151515 May 31 21:19:05.567999 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 600/1220] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:19:05 2022] GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:19:06.584288 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-d5e224d1-2565-4dc8-8bae-2833e9451a57 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:19:06.585493 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-d5e224d1-2565-4dc8-8bae-2833e9451a57 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] [instance: 45453898-e1e4-44bb-8af5-3a1729aa2870] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:19:06.591975 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d5e224d1-2565-4dc8-8bae-2833e9451a57 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:06.592427 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d5e224d1-2565-4dc8-8bae-2833e9451a57 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:06.593183 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d5e224d1-2565-4dc8-8bae-2833e9451a57 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:06.593613 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d5e224d1-2565-4dc8-8bae-2833e9451a57 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:06.720795 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-d5e224d1-2565-4dc8-8bae-2833e9451a57 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782845f8e6a440b684ae46a6ed118a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c46b1e7a32484b9c22387f2aaeb871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:19:06.728186 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-d5e224d1-2565-4dc8-8bae-2833e9451a57 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] 10.222.0.55 "GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870" status: 200 len: 1570 microversion: 2.1 time: 0.147824 May 31 21:19:06.728739 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 621/1221] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:19:06 2022] GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870 => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:19:07.745350 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-fd4b8c38-032c-4ba8-bbcd-b3094474d9c8 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:19:07.746045 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-fd4b8c38-032c-4ba8-bbcd-b3094474d9c8 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] [instance: 45453898-e1e4-44bb-8af5-3a1729aa2870] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:19:07.752532 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-fd4b8c38-032c-4ba8-bbcd-b3094474d9c8 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:07.753013 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-fd4b8c38-032c-4ba8-bbcd-b3094474d9c8 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:07.753783 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-fd4b8c38-032c-4ba8-bbcd-b3094474d9c8 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:07.754253 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-fd4b8c38-032c-4ba8-bbcd-b3094474d9c8 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:07.880652 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-fd4b8c38-032c-4ba8-bbcd-b3094474d9c8 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782845f8e6a440b684ae46a6ed118a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c46b1e7a32484b9c22387f2aaeb871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:19:07.888731 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-fd4b8c38-032c-4ba8-bbcd-b3094474d9c8 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] 10.222.0.55 "GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870" status: 200 len: 1570 microversion: 2.1 time: 0.147751 May 31 21:19:07.889297 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 601/1222] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:19:07 2022] GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870 => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:19:08.905531 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-65772589-27d1-4081-859d-cf122a294da3 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:19:08.906155 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-65772589-27d1-4081-859d-cf122a294da3 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] [instance: 45453898-e1e4-44bb-8af5-3a1729aa2870] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:19:08.912607 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-65772589-27d1-4081-859d-cf122a294da3 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:08.913049 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-65772589-27d1-4081-859d-cf122a294da3 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:08.913796 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-65772589-27d1-4081-859d-cf122a294da3 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:08.914247 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-65772589-27d1-4081-859d-cf122a294da3 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:09.043089 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-65772589-27d1-4081-859d-cf122a294da3 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782845f8e6a440b684ae46a6ed118a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c46b1e7a32484b9c22387f2aaeb871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:19:09.050480 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-65772589-27d1-4081-859d-cf122a294da3 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] 10.222.0.55 "GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870" status: 200 len: 1570 microversion: 2.1 time: 0.148695 May 31 21:19:09.050978 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 622/1223] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:19:08 2022] GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:19:10.068109 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-99af0156-5695-4890-bedb-6e717bcd6dbc tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:19:10.069482 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-99af0156-5695-4890-bedb-6e717bcd6dbc tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] [instance: 45453898-e1e4-44bb-8af5-3a1729aa2870] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:19:10.076260 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-99af0156-5695-4890-bedb-6e717bcd6dbc tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:10.076707 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-99af0156-5695-4890-bedb-6e717bcd6dbc tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:10.077466 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-99af0156-5695-4890-bedb-6e717bcd6dbc tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:10.077921 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-99af0156-5695-4890-bedb-6e717bcd6dbc tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:10.207394 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-99af0156-5695-4890-bedb-6e717bcd6dbc tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782845f8e6a440b684ae46a6ed118a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c46b1e7a32484b9c22387f2aaeb871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:19:10.214966 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-99af0156-5695-4890-bedb-6e717bcd6dbc tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] 10.222.0.55 "GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870" status: 200 len: 1570 microversion: 2.1 time: 0.150697 May 31 21:19:10.215763 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 602/1224] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:19:10 2022] GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:19:11.231080 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-c28f6baf-92dd-4859-8fc2-fd46f17b62f2 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:19:11.231711 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-c28f6baf-92dd-4859-8fc2-fd46f17b62f2 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] [instance: 45453898-e1e4-44bb-8af5-3a1729aa2870] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:19:11.238453 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c28f6baf-92dd-4859-8fc2-fd46f17b62f2 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:11.238891 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c28f6baf-92dd-4859-8fc2-fd46f17b62f2 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:11.239643 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c28f6baf-92dd-4859-8fc2-fd46f17b62f2 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:11.240067 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c28f6baf-92dd-4859-8fc2-fd46f17b62f2 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:11.370242 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-c28f6baf-92dd-4859-8fc2-fd46f17b62f2 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782845f8e6a440b684ae46a6ed118a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c46b1e7a32484b9c22387f2aaeb871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:19:11.377617 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-c28f6baf-92dd-4859-8fc2-fd46f17b62f2 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] 10.222.0.55 "GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870" status: 200 len: 1570 microversion: 2.1 time: 0.150407 May 31 21:19:11.378202 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 623/1225] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:19:11 2022] GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:19:12.394066 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-70c5a31d-84c8-4d1b-8dfd-1b60d8e6c3e5 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:19:12.394678 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-70c5a31d-84c8-4d1b-8dfd-1b60d8e6c3e5 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] [instance: 45453898-e1e4-44bb-8af5-3a1729aa2870] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:19:12.401850 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-70c5a31d-84c8-4d1b-8dfd-1b60d8e6c3e5 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:12.402325 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-70c5a31d-84c8-4d1b-8dfd-1b60d8e6c3e5 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:12.403090 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-70c5a31d-84c8-4d1b-8dfd-1b60d8e6c3e5 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:12.403528 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-70c5a31d-84c8-4d1b-8dfd-1b60d8e6c3e5 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:12.535332 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-70c5a31d-84c8-4d1b-8dfd-1b60d8e6c3e5 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782845f8e6a440b684ae46a6ed118a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c46b1e7a32484b9c22387f2aaeb871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:19:12.542984 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-70c5a31d-84c8-4d1b-8dfd-1b60d8e6c3e5 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] 10.222.0.55 "GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870" status: 200 len: 1570 microversion: 2.1 time: 0.152766 May 31 21:19:12.543554 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 603/1226] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:19:12 2022] GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:19:13.559396 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-5830c9a2-35ab-4787-bd26-1cebd8c23eb8 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:19:13.560006 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-5830c9a2-35ab-4787-bd26-1cebd8c23eb8 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] [instance: 45453898-e1e4-44bb-8af5-3a1729aa2870] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:19:13.566061 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5830c9a2-35ab-4787-bd26-1cebd8c23eb8 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:13.569609 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5830c9a2-35ab-4787-bd26-1cebd8c23eb8 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:13.569609 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5830c9a2-35ab-4787-bd26-1cebd8c23eb8 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:13.569609 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-5830c9a2-35ab-4787-bd26-1cebd8c23eb8 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:13.698886 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-5830c9a2-35ab-4787-bd26-1cebd8c23eb8 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782845f8e6a440b684ae46a6ed118a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c46b1e7a32484b9c22387f2aaeb871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:19:13.706212 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-5830c9a2-35ab-4787-bd26-1cebd8c23eb8 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] 10.222.0.55 "GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870" status: 200 len: 1511 microversion: 2.1 time: 0.150908 May 31 21:19:13.706770 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 624/1227] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:19:13 2022] GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870 => generated 1511 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:19:13.723756 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-342a1e7f-d8d0-40b9-9297-1731a12cf35c tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:19:13.724328 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-342a1e7f-d8d0-40b9-9297-1731a12cf35c tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] [instance: 45453898-e1e4-44bb-8af5-3a1729aa2870] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:19:13.731564 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-342a1e7f-d8d0-40b9-9297-1731a12cf35c tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:13.732023 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-342a1e7f-d8d0-40b9-9297-1731a12cf35c tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:13.732795 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-342a1e7f-d8d0-40b9-9297-1731a12cf35c tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:13.733235 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-342a1e7f-d8d0-40b9-9297-1731a12cf35c tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:13.976390 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-342a1e7f-d8d0-40b9-9297-1731a12cf35c tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] 10.222.0.55 "POST /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870/action" status: 202 len: 0 microversion: 2.1 time: 0.256425 May 31 21:19:13.977000 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 604/1228] 10.222.0.55 () {60 vars in 1277 bytes} [Tue May 31 21:19:13 2022] POST /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 21:19:13.985262 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-6c2c664d-f5cf-4974-a0f3-1b37ee5df3fc tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:19:13.990951 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-6c2c664d-f5cf-4974-a0f3-1b37ee5df3fc tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] [instance: 45453898-e1e4-44bb-8af5-3a1729aa2870] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:19:13.991776 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6c2c664d-f5cf-4974-a0f3-1b37ee5df3fc tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:13.992056 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6c2c664d-f5cf-4974-a0f3-1b37ee5df3fc tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:13.992832 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6c2c664d-f5cf-4974-a0f3-1b37ee5df3fc tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:13.993270 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6c2c664d-f5cf-4974-a0f3-1b37ee5df3fc tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:14.122290 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-6c2c664d-f5cf-4974-a0f3-1b37ee5df3fc tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782845f8e6a440b684ae46a6ed118a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c46b1e7a32484b9c22387f2aaeb871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:19:14.130018 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-6c2c664d-f5cf-4974-a0f3-1b37ee5df3fc tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] 10.222.0.55 "GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870" status: 200 len: 1519 microversion: 2.1 time: 0.148728 May 31 21:19:14.130578 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 625/1229] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:19:13 2022] GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870 => generated 1519 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:19:15.147743 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-a1ce7058-201d-4ee8-90b7-1bc6e5b273bf tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:19:15.148368 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-a1ce7058-201d-4ee8-90b7-1bc6e5b273bf tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] [instance: 45453898-e1e4-44bb-8af5-3a1729aa2870] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:19:15.154534 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a1ce7058-201d-4ee8-90b7-1bc6e5b273bf tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:15.154995 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a1ce7058-201d-4ee8-90b7-1bc6e5b273bf tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:15.155775 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a1ce7058-201d-4ee8-90b7-1bc6e5b273bf tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:15.156221 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a1ce7058-201d-4ee8-90b7-1bc6e5b273bf tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:15.299477 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-a1ce7058-201d-4ee8-90b7-1bc6e5b273bf tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782845f8e6a440b684ae46a6ed118a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c46b1e7a32484b9c22387f2aaeb871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:19:15.307023 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-a1ce7058-201d-4ee8-90b7-1bc6e5b273bf tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] 10.222.0.55 "GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870" status: 200 len: 1521 microversion: 2.1 time: 0.163702 May 31 21:19:15.307591 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 605/1230] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:19:15 2022] GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:19:15.637109 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [req-d275667f-a68b-4b82-b358-296723e032cb req-c16407c5-ebb4-4122-9571-74aebcc1c380 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45453898-e1e4-44bb-8af5-3a1729aa2870", "name": "network-vif-unplugged", "status": "completed", "tag": "6278ba73-77b2-4be4-a1a0-b7b239769dc3"}]} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:19:15.647476 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-d275667f-a68b-4b82-b358-296723e032cb req-c16407c5-ebb4-4122-9571-74aebcc1c380 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:15.647930 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-d275667f-a68b-4b82-b358-296723e032cb req-c16407c5-ebb4-4122-9571-74aebcc1c380 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:15.659380 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.compute.server_external_events [req-d275667f-a68b-4b82-b358-296723e032cb req-c16407c5-ebb4-4122-9571-74aebcc1c380 service nova] Unable to find a host for instance 45453898-e1e4-44bb-8af5-3a1729aa2870. Dropping event network-vif-unplugged {{(pid=118184) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 31 21:19:15.660282 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [req-d275667f-a68b-4b82-b358-296723e032cb req-c16407c5-ebb4-4122-9571-74aebcc1c380 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027006 May 31 21:19:15.660862 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 626/1231] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:19:15 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 31 21:19:16.326767 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-7db6e616-84f5-42ca-9744-5c26cb2ad514 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:19:16.327316 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-7db6e616-84f5-42ca-9744-5c26cb2ad514 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] [instance: 45453898-e1e4-44bb-8af5-3a1729aa2870] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:19:16.333779 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-7db6e616-84f5-42ca-9744-5c26cb2ad514 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:16.334264 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-7db6e616-84f5-42ca-9744-5c26cb2ad514 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:16.335064 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-7db6e616-84f5-42ca-9744-5c26cb2ad514 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:16.335506 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-7db6e616-84f5-42ca-9744-5c26cb2ad514 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:16.465380 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-7db6e616-84f5-42ca-9744-5c26cb2ad514 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782845f8e6a440b684ae46a6ed118a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c46b1e7a32484b9c22387f2aaeb871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:19:16.472841 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-7db6e616-84f5-42ca-9744-5c26cb2ad514 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] 10.222.0.55 "GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870" status: 200 len: 1577 microversion: 2.1 time: 0.150171 May 31 21:19:16.473403 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 606/1232] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:19:16 2022] GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870 => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:19:17.490097 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-d669d640-f0e3-4cf6-9893-e218ab7d313b tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:19:17.490713 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-d669d640-f0e3-4cf6-9893-e218ab7d313b tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] [instance: 45453898-e1e4-44bb-8af5-3a1729aa2870] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:19:17.497436 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d669d640-f0e3-4cf6-9893-e218ab7d313b tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:17.497880 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d669d640-f0e3-4cf6-9893-e218ab7d313b tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:17.498676 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d669d640-f0e3-4cf6-9893-e218ab7d313b tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:17.499103 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d669d640-f0e3-4cf6-9893-e218ab7d313b tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:17.625516 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-d669d640-f0e3-4cf6-9893-e218ab7d313b tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782845f8e6a440b684ae46a6ed118a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c46b1e7a32484b9c22387f2aaeb871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:19:17.633479 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-d669d640-f0e3-4cf6-9893-e218ab7d313b tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] 10.222.0.55 "GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870" status: 200 len: 1577 microversion: 2.1 time: 0.147282 May 31 21:19:17.634070 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 627/1233] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:19:17 2022] GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870 => generated 1577 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:19:18.650901 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-ced75e92-6d7f-46c2-b615-c58854f899e7 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:19:18.651693 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-ced75e92-6d7f-46c2-b615-c58854f899e7 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] [instance: 45453898-e1e4-44bb-8af5-3a1729aa2870] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:19:18.657765 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ced75e92-6d7f-46c2-b615-c58854f899e7 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:18.658323 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ced75e92-6d7f-46c2-b615-c58854f899e7 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:18.659082 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ced75e92-6d7f-46c2-b615-c58854f899e7 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:18.659515 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-ced75e92-6d7f-46c2-b615-c58854f899e7 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:18.792475 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-ced75e92-6d7f-46c2-b615-c58854f899e7 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782845f8e6a440b684ae46a6ed118a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c46b1e7a32484b9c22387f2aaeb871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:19:18.799939 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-ced75e92-6d7f-46c2-b615-c58854f899e7 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] 10.222.0.55 "GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870" status: 200 len: 1577 microversion: 2.1 time: 0.153641 May 31 21:19:18.800500 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 607/1234] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:19:18 2022] GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870 => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:19:19.816409 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-a35fb11f-2b9c-493b-bbbe-f8a54f8edacc tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:19:19.817013 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-a35fb11f-2b9c-493b-bbbe-f8a54f8edacc tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] [instance: 45453898-e1e4-44bb-8af5-3a1729aa2870] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:19:19.823679 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a35fb11f-2b9c-493b-bbbe-f8a54f8edacc tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:19.824119 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a35fb11f-2b9c-493b-bbbe-f8a54f8edacc tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:19.824873 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a35fb11f-2b9c-493b-bbbe-f8a54f8edacc tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:19.825301 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-a35fb11f-2b9c-493b-bbbe-f8a54f8edacc tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:19.953337 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-a35fb11f-2b9c-493b-bbbe-f8a54f8edacc tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782845f8e6a440b684ae46a6ed118a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c46b1e7a32484b9c22387f2aaeb871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:19:19.961414 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-a35fb11f-2b9c-493b-bbbe-f8a54f8edacc tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] 10.222.0.55 "GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870" status: 200 len: 1577 microversion: 2.1 time: 0.148849 May 31 21:19:19.961997 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 628/1235] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:19:19 2022] GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870 => generated 1577 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:19:20.978582 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-0dd2f67d-a8a8-4492-bd43-d71b04e305df tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:19:20.979197 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-0dd2f67d-a8a8-4492-bd43-d71b04e305df tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] [instance: 45453898-e1e4-44bb-8af5-3a1729aa2870] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:19:20.985710 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-0dd2f67d-a8a8-4492-bd43-d71b04e305df tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:20.986209 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-0dd2f67d-a8a8-4492-bd43-d71b04e305df tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:20.986978 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-0dd2f67d-a8a8-4492-bd43-d71b04e305df tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:20.987420 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-0dd2f67d-a8a8-4492-bd43-d71b04e305df tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:21.116712 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-0dd2f67d-a8a8-4492-bd43-d71b04e305df tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782845f8e6a440b684ae46a6ed118a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c46b1e7a32484b9c22387f2aaeb871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:19:21.124170 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-0dd2f67d-a8a8-4492-bd43-d71b04e305df tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] 10.222.0.55 "GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870" status: 200 len: 1577 microversion: 2.1 time: 0.149994 May 31 21:19:21.124738 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 608/1236] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:19:20 2022] GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870 => generated 1577 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:19:22.140958 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-c9c3b8ac-862d-4169-9fa6-07d609ed9729 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:19:22.141564 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-c9c3b8ac-862d-4169-9fa6-07d609ed9729 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] [instance: 45453898-e1e4-44bb-8af5-3a1729aa2870] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:19:22.148133 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c9c3b8ac-862d-4169-9fa6-07d609ed9729 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:22.148574 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c9c3b8ac-862d-4169-9fa6-07d609ed9729 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:22.149321 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c9c3b8ac-862d-4169-9fa6-07d609ed9729 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:22.149744 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c9c3b8ac-862d-4169-9fa6-07d609ed9729 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:22.284980 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-c9c3b8ac-862d-4169-9fa6-07d609ed9729 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782845f8e6a440b684ae46a6ed118a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c46b1e7a32484b9c22387f2aaeb871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:19:22.293411 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-c9c3b8ac-862d-4169-9fa6-07d609ed9729 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] 10.222.0.55 "GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870" status: 200 len: 1577 microversion: 2.1 time: 0.156317 May 31 21:19:22.294003 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 629/1237] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:19:22 2022] GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870 => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:19:23.310445 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-e01c5d17-9225-4f7a-88a5-39723524a4a4 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:19:23.311057 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-e01c5d17-9225-4f7a-88a5-39723524a4a4 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] [instance: 45453898-e1e4-44bb-8af5-3a1729aa2870] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:19:23.317564 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e01c5d17-9225-4f7a-88a5-39723524a4a4 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:23.318053 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e01c5d17-9225-4f7a-88a5-39723524a4a4 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:23.318825 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e01c5d17-9225-4f7a-88a5-39723524a4a4 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:23.319926 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-e01c5d17-9225-4f7a-88a5-39723524a4a4 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:23.450104 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-e01c5d17-9225-4f7a-88a5-39723524a4a4 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782845f8e6a440b684ae46a6ed118a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c46b1e7a32484b9c22387f2aaeb871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:19:23.457514 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-e01c5d17-9225-4f7a-88a5-39723524a4a4 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] 10.222.0.55 "GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870" status: 200 len: 1577 microversion: 2.1 time: 0.150981 May 31 21:19:23.463370 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 609/1238] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:19:23 2022] GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870 => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:19:24.474453 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-1586bbbb-d892-4625-91ea-55473aed3f02 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:19:24.475064 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-1586bbbb-d892-4625-91ea-55473aed3f02 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] [instance: 45453898-e1e4-44bb-8af5-3a1729aa2870] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:19:24.481507 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-1586bbbb-d892-4625-91ea-55473aed3f02 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:24.485614 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-1586bbbb-d892-4625-91ea-55473aed3f02 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:24.485614 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-1586bbbb-d892-4625-91ea-55473aed3f02 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:24.485614 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-1586bbbb-d892-4625-91ea-55473aed3f02 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:24.611381 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-1586bbbb-d892-4625-91ea-55473aed3f02 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782845f8e6a440b684ae46a6ed118a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c46b1e7a32484b9c22387f2aaeb871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:19:24.619489 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-1586bbbb-d892-4625-91ea-55473aed3f02 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] 10.222.0.55 "GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870" status: 200 len: 1577 microversion: 2.1 time: 0.148867 May 31 21:19:24.620052 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 630/1239] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:19:24 2022] GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870 => generated 1577 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:19:25.636565 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-4bf4551d-5cc6-4724-a99d-243575d78c3f tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:19:25.637185 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-4bf4551d-5cc6-4724-a99d-243575d78c3f tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] [instance: 45453898-e1e4-44bb-8af5-3a1729aa2870] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:19:25.643826 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4bf4551d-5cc6-4724-a99d-243575d78c3f tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:25.644278 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4bf4551d-5cc6-4724-a99d-243575d78c3f tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:25.645050 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4bf4551d-5cc6-4724-a99d-243575d78c3f tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:25.645487 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-4bf4551d-5cc6-4724-a99d-243575d78c3f tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:25.664789 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:19:25.777186 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-4bf4551d-5cc6-4724-a99d-243575d78c3f tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782845f8e6a440b684ae46a6ed118a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c46b1e7a32484b9c22387f2aaeb871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:19:25.784681 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-4bf4551d-5cc6-4724-a99d-243575d78c3f tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] 10.222.0.55 "GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870" status: 200 len: 1577 microversion: 2.1 time: 0.152073 May 31 21:19:25.785259 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 610/1240] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:19:25 2022] GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870 => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:19:26.802136 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-bd5d05fe-4f36-4ba6-a1ca-fde5bdd207ec tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:19:26.802752 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-bd5d05fe-4f36-4ba6-a1ca-fde5bdd207ec tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] [instance: 45453898-e1e4-44bb-8af5-3a1729aa2870] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:19:26.810021 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-bd5d05fe-4f36-4ba6-a1ca-fde5bdd207ec tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:26.810471 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-bd5d05fe-4f36-4ba6-a1ca-fde5bdd207ec tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:26.811238 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-bd5d05fe-4f36-4ba6-a1ca-fde5bdd207ec tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:26.811675 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-bd5d05fe-4f36-4ba6-a1ca-fde5bdd207ec tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:26.940765 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-bd5d05fe-4f36-4ba6-a1ca-fde5bdd207ec tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782845f8e6a440b684ae46a6ed118a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c46b1e7a32484b9c22387f2aaeb871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:19:26.948609 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-bd5d05fe-4f36-4ba6-a1ca-fde5bdd207ec tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] 10.222.0.55 "GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870" status: 200 len: 1577 microversion: 2.1 time: 0.150436 May 31 21:19:26.949187 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 631/1241] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:19:26 2022] GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870 => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:19:27.805319 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [req-8856cc52-014b-4cc9-b0de-156daf884973 req-35107702-d779-430f-a6fe-d09827374c32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45453898-e1e4-44bb-8af5-3a1729aa2870", "name": "network-vif-plugged", "status": "completed", "tag": "6278ba73-77b2-4be4-a1a0-b7b239769dc3"}]} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:19:27.813546 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-8856cc52-014b-4cc9-b0de-156daf884973 req-35107702-d779-430f-a6fe-d09827374c32 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:27.814013 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-8856cc52-014b-4cc9-b0de-156daf884973 req-35107702-d779-430f-a6fe-d09827374c32 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:27.825809 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.compute.server_external_events [req-8856cc52-014b-4cc9-b0de-156daf884973 req-35107702-d779-430f-a6fe-d09827374c32 service nova] Creating event network-vif-plugged:6278ba73-77b2-4be4-a1a0-b7b239769dc3 for instance 45453898-e1e4-44bb-8af5-3a1729aa2870 on hv-cinder-83979 May 31 21:19:27.830863 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [req-8856cc52-014b-4cc9-b0de-156daf884973 req-35107702-d779-430f-a6fe-d09827374c32 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087587 May 31 21:19:27.831484 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 611/1242] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 21:19:27.964484 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-c71b6176-3e8e-478e-8bd5-3e1065866882 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:19:27.965088 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-c71b6176-3e8e-478e-8bd5-3e1065866882 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] [instance: 45453898-e1e4-44bb-8af5-3a1729aa2870] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:19:27.972163 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c71b6176-3e8e-478e-8bd5-3e1065866882 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:27.972163 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c71b6176-3e8e-478e-8bd5-3e1065866882 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:27.972823 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c71b6176-3e8e-478e-8bd5-3e1065866882 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:27.973133 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c71b6176-3e8e-478e-8bd5-3e1065866882 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:28.102836 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-c71b6176-3e8e-478e-8bd5-3e1065866882 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782845f8e6a440b684ae46a6ed118a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c46b1e7a32484b9c22387f2aaeb871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:19:28.110530 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-c71b6176-3e8e-478e-8bd5-3e1065866882 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] 10.222.0.55 "GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870" status: 200 len: 1577 microversion: 2.1 time: 0.149902 May 31 21:19:28.111098 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 632/1243] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:19:27 2022] GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870 => generated 1577 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:19:29.129064 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-a85b08e0-4430-438d-9bac-efa448f42fbb tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:19:29.129694 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-a85b08e0-4430-438d-9bac-efa448f42fbb tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] [instance: 45453898-e1e4-44bb-8af5-3a1729aa2870] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:19:29.136371 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a85b08e0-4430-438d-9bac-efa448f42fbb tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:29.136814 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a85b08e0-4430-438d-9bac-efa448f42fbb tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:29.137759 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a85b08e0-4430-438d-9bac-efa448f42fbb tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:29.138222 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-a85b08e0-4430-438d-9bac-efa448f42fbb tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:29.270525 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-a85b08e0-4430-438d-9bac-efa448f42fbb tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782845f8e6a440b684ae46a6ed118a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c46b1e7a32484b9c22387f2aaeb871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:19:29.278501 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-a85b08e0-4430-438d-9bac-efa448f42fbb tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] 10.222.0.55 "GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870" status: 200 len: 1577 microversion: 2.1 time: 0.154220 May 31 21:19:29.279095 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 612/1244] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:19:29 2022] GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870 => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:19:30.295722 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-fb0909ba-d730-4795-9593-46919709f5f1 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:19:30.296327 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-fb0909ba-d730-4795-9593-46919709f5f1 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] [instance: 45453898-e1e4-44bb-8af5-3a1729aa2870] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:19:30.298665 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_api:SELECT=31 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:19:30.303397 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-fb0909ba-d730-4795-9593-46919709f5f1 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:30.303852 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-fb0909ba-d730-4795-9593-46919709f5f1 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:30.304618 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-fb0909ba-d730-4795-9593-46919709f5f1 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:30.305058 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-fb0909ba-d730-4795-9593-46919709f5f1 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:30.308964 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell1:SELECT=87 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:19:30.433358 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-fb0909ba-d730-4795-9593-46919709f5f1 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782845f8e6a440b684ae46a6ed118a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c46b1e7a32484b9c22387f2aaeb871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:19:30.440825 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-fb0909ba-d730-4795-9593-46919709f5f1 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] 10.222.0.55 "GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870" status: 200 len: 1564 microversion: 2.1 time: 0.149024 May 31 21:19:30.441495 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 633/1245] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:19:30 2022] GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870 => generated 1564 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:19:47.661564 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-f8b82b7a-963d-4a05-8836-b0c40dc592d1 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:19:47.662182 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-f8b82b7a-963d-4a05-8836-b0c40dc592d1 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 903d1b05-7ed1-4b57-9325-7671d72d4284] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:19:47.665137 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_api:SELECT=34 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:19:47.665885 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell1:SELECT=10 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:19:47.670515 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f8b82b7a-963d-4a05-8836-b0c40dc592d1 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:47.670967 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f8b82b7a-963d-4a05-8836-b0c40dc592d1 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:47.671733 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f8b82b7a-963d-4a05-8836-b0c40dc592d1 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:47.672171 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f8b82b7a-963d-4a05-8836-b0c40dc592d1 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:47.694728 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-f8b82b7a-963d-4a05-8836-b0c40dc592d1 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/903d1b05-7ed1-4b57-9325-7671d72d4284/ips" status: 200 len: 149 microversion: 2.1 time: 0.037030 May 31 21:19:47.695289 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 613/1246] 10.222.0.55 () {58 vars in 1247 bytes} [Tue May 31 21:19:47 2022] GET /compute/v2.1/servers/903d1b05-7ed1-4b57-9325-7671d72d4284/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 21:19:49.280527 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-6bbd1a70-e91c-42be-a1e2-5dfa12518acf tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5ecf4c25-b301-4f4b-b3d3-4945708ce680"}} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:19:49.281584 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-6bbd1a70-e91c-42be-a1e2-5dfa12518acf tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 903d1b05-7ed1-4b57-9325-7671d72d4284] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:19:49.283599 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_api:SELECT=1 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:19:49.286487 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell1:SELECT=5 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:19:49.289437 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6bbd1a70-e91c-42be-a1e2-5dfa12518acf tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:49.289885 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6bbd1a70-e91c-42be-a1e2-5dfa12518acf tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:49.290680 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6bbd1a70-e91c-42be-a1e2-5dfa12518acf tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:49.291113 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-6bbd1a70-e91c-42be-a1e2-5dfa12518acf tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:50.017499 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-6bbd1a70-e91c-42be-a1e2-5dfa12518acf tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "POST /compute/v2.1/servers/903d1b05-7ed1-4b57-9325-7671d72d4284/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.740586 May 31 21:19:50.018139 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 634/1247] 10.222.0.55 () {60 vars in 1322 bytes} [Tue May 31 21:19:49 2022] POST /compute/v2.1/servers/903d1b05-7ed1-4b57-9325-7671d72d4284/os-volume_attachments => generated 194 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:19:57.588884 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-620c326e-a495-40d9-8e95-d24651f12709 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:19:57.589429 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-620c326e-a495-40d9-8e95-d24651f12709 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 903d1b05-7ed1-4b57-9325-7671d72d4284] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:19:57.596336 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-620c326e-a495-40d9-8e95-d24651f12709 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:57.597525 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-620c326e-a495-40d9-8e95-d24651f12709 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:57.597714 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-620c326e-a495-40d9-8e95-d24651f12709 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:57.598158 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-620c326e-a495-40d9-8e95-d24651f12709 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:57.675994 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.objects.instance [None req-620c326e-a495-40d9-8e95-d24651f12709 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lazy-loading 'services' on Instance uuid 903d1b05-7ed1-4b57-9325-7671d72d4284 {{(pid=118185) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 21:19:57.920335 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-620c326e-a495-40d9-8e95-d24651f12709 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "DELETE /compute/v2.1/servers/903d1b05-7ed1-4b57-9325-7671d72d4284/os-volume_attachments/5ecf4c25-b301-4f4b-b3d3-4945708ce680" status: 202 len: 0 microversion: 2.1 time: 0.335741 May 31 21:19:57.920875 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 614/1248] 10.222.0.55 () {58 vars in 1415 bytes} [Tue May 31 21:19:57 2022] DELETE /compute/v2.1/servers/903d1b05-7ed1-4b57-9325-7671d72d4284/os-volume_attachments/5ecf4c25-b301-4f4b-b3d3-4945708ce680 => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 21:19:57.930934 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-f4a677c3-24d1-47c8-8251-2e3c12e9cf07 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:19:57.933743 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-f4a677c3-24d1-47c8-8251-2e3c12e9cf07 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 903d1b05-7ed1-4b57-9325-7671d72d4284] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:19:57.938902 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f4a677c3-24d1-47c8-8251-2e3c12e9cf07 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:57.939347 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f4a677c3-24d1-47c8-8251-2e3c12e9cf07 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:57.940102 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f4a677c3-24d1-47c8-8251-2e3c12e9cf07 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:57.940679 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-f4a677c3-24d1-47c8-8251-2e3c12e9cf07 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:57.971393 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-f4a677c3-24d1-47c8-8251-2e3c12e9cf07 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/903d1b05-7ed1-4b57-9325-7671d72d4284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045463 May 31 21:19:57.971946 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 635/1249] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 31 21:19:57 2022] GET /compute/v2.1/servers/903d1b05-7ed1-4b57-9325-7671d72d4284/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:19:58.982716 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-c2ac777a-2c39-4039-999d-1e601c53fb0e tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:19:58.983789 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-c2ac777a-2c39-4039-999d-1e601c53fb0e tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 903d1b05-7ed1-4b57-9325-7671d72d4284] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:19:58.990526 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c2ac777a-2c39-4039-999d-1e601c53fb0e tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:58.990980 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c2ac777a-2c39-4039-999d-1e601c53fb0e tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:58.991748 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c2ac777a-2c39-4039-999d-1e601c53fb0e tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:58.992186 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c2ac777a-2c39-4039-999d-1e601c53fb0e tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:59.019996 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-c2ac777a-2c39-4039-999d-1e601c53fb0e tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/903d1b05-7ed1-4b57-9325-7671d72d4284/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041545 May 31 21:19:59.020604 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 615/1250] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 31 21:19:58 2022] GET /compute/v2.1/servers/903d1b05-7ed1-4b57-9325-7671d72d4284/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 31 21:19:59.081808 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-c11008ee-2633-4513-bb24-0afc2e7989a0 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:19:59.082340 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-c11008ee-2633-4513-bb24-0afc2e7989a0 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 903d1b05-7ed1-4b57-9325-7671d72d4284] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:19:59.089468 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c11008ee-2633-4513-bb24-0afc2e7989a0 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:59.089941 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c11008ee-2633-4513-bb24-0afc2e7989a0 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:59.090701 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c11008ee-2633-4513-bb24-0afc2e7989a0 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:59.091136 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c11008ee-2633-4513-bb24-0afc2e7989a0 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:59.115494 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-c11008ee-2633-4513-bb24-0afc2e7989a0 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 903d1b05-7ed1-4b57-9325-7671d72d4284] Going to try to terminate instance {{(pid=118184) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 21:19:59.417061 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-c11008ee-2633-4513-bb24-0afc2e7989a0 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "DELETE /compute/v2.1/servers/903d1b05-7ed1-4b57-9325-7671d72d4284" status: 204 len: 0 microversion: 2.1 time: 0.338777 May 31 21:19:59.417573 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 636/1251] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 31 21:19:59 2022] DELETE /compute/v2.1/servers/903d1b05-7ed1-4b57-9325-7671d72d4284 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 31 21:19:59.425649 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-80d6abc9-78c7-4d99-bdd5-9948757b17d1 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:19:59.426317 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-80d6abc9-78c7-4d99-bdd5-9948757b17d1 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 903d1b05-7ed1-4b57-9325-7671d72d4284] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:19:59.433153 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-80d6abc9-78c7-4d99-bdd5-9948757b17d1 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:59.433605 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-80d6abc9-78c7-4d99-bdd5-9948757b17d1 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:59.434407 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-80d6abc9-78c7-4d99-bdd5-9948757b17d1 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:19:59.434848 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-80d6abc9-78c7-4d99-bdd5-9948757b17d1 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:19:59.561098 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-80d6abc9-78c7-4d99-bdd5-9948757b17d1 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe37a6d57b4775b4e47a295c3f5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b2364f40d14160adf0220d92adaad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:19:59.568490 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-80d6abc9-78c7-4d99-bdd5-9948757b17d1 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/903d1b05-7ed1-4b57-9325-7671d72d4284" status: 200 len: 1682 microversion: 2.1 time: 0.146693 May 31 21:19:59.569046 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 616/1252] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:19:59 2022] GET /compute/v2.1/servers/903d1b05-7ed1-4b57-9325-7671d72d4284 => generated 1682 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:20:00.592540 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-3f1064f8-643b-425a-bcfa-336bb7da40c0 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:20:00.593241 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-3f1064f8-643b-425a-bcfa-336bb7da40c0 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 903d1b05-7ed1-4b57-9325-7671d72d4284] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:20:00.599815 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-3f1064f8-643b-425a-bcfa-336bb7da40c0 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:20:00.600263 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-3f1064f8-643b-425a-bcfa-336bb7da40c0 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:20:00.601022 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-3f1064f8-643b-425a-bcfa-336bb7da40c0 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:20:00.601458 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-3f1064f8-643b-425a-bcfa-336bb7da40c0 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:20:00.733468 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-3f1064f8-643b-425a-bcfa-336bb7da40c0 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe37a6d57b4775b4e47a295c3f5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b2364f40d14160adf0220d92adaad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:20:00.741026 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-3f1064f8-643b-425a-bcfa-336bb7da40c0 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/903d1b05-7ed1-4b57-9325-7671d72d4284" status: 200 len: 1682 microversion: 2.1 time: 0.152742 May 31 21:20:00.741600 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 637/1253] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:20:00 2022] GET /compute/v2.1/servers/903d1b05-7ed1-4b57-9325-7671d72d4284 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:20:01.757984 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-756582cd-6e41-4c9e-ad86-59c8cc86f2c3 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:20:01.758596 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-756582cd-6e41-4c9e-ad86-59c8cc86f2c3 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 903d1b05-7ed1-4b57-9325-7671d72d4284] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:20:01.764902 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-756582cd-6e41-4c9e-ad86-59c8cc86f2c3 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:20:01.765358 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-756582cd-6e41-4c9e-ad86-59c8cc86f2c3 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:20:01.766135 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-756582cd-6e41-4c9e-ad86-59c8cc86f2c3 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:20:01.766573 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-756582cd-6e41-4c9e-ad86-59c8cc86f2c3 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:20:01.832736 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-756582cd-6e41-4c9e-ad86-59c8cc86f2c3 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe37a6d57b4775b4e47a295c3f5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b2364f40d14160adf0220d92adaad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:20:01.840785 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-756582cd-6e41-4c9e-ad86-59c8cc86f2c3 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/903d1b05-7ed1-4b57-9325-7671d72d4284" status: 200 len: 1614 microversion: 2.1 time: 0.086649 May 31 21:20:01.841939 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 617/1254] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:20:01 2022] GET /compute/v2.1/servers/903d1b05-7ed1-4b57-9325-7671d72d4284 => generated 1614 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:20:02.084027 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [req-519dd307-8dfd-4cc7-bd2a-c31c97f0c7f5 req-376b223b-bbd4-4f68-ba0e-1e15bab9c402 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "903d1b05-7ed1-4b57-9325-7671d72d4284", "name": "network-vif-deleted", "tag": "54a3d30c-a1ca-4282-8b04-891f97fda031"}]} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:20:02.096619 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-519dd307-8dfd-4cc7-bd2a-c31c97f0c7f5 req-376b223b-bbd4-4f68-ba0e-1e15bab9c402 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:20:02.096619 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-519dd307-8dfd-4cc7-bd2a-c31c97f0c7f5 req-376b223b-bbd4-4f68-ba0e-1e15bab9c402 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:20:02.105065 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.compute.server_external_events [req-519dd307-8dfd-4cc7-bd2a-c31c97f0c7f5 req-376b223b-bbd4-4f68-ba0e-1e15bab9c402 service nova] Creating event network-vif-deleted:54a3d30c-a1ca-4282-8b04-891f97fda031 for instance 903d1b05-7ed1-4b57-9325-7671d72d4284 on hv-cinder-83979 May 31 21:20:02.110133 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [req-519dd307-8dfd-4cc7-bd2a-c31c97f0c7f5 req-376b223b-bbd4-4f68-ba0e-1e15bab9c402 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029660 May 31 21:20:02.110744 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 638/1255] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:20:02.862383 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-fa5269df-7bc5-4606-816d-c38eef305079 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:20:02.862996 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-fa5269df-7bc5-4606-816d-c38eef305079 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 903d1b05-7ed1-4b57-9325-7671d72d4284] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:20:02.870102 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-fa5269df-7bc5-4606-816d-c38eef305079 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:20:02.870559 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-fa5269df-7bc5-4606-816d-c38eef305079 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:20:02.871321 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-fa5269df-7bc5-4606-816d-c38eef305079 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:20:02.871760 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-fa5269df-7bc5-4606-816d-c38eef305079 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:20:02.885869 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.wsgi [None req-fa5269df-7bc5-4606-816d-c38eef305079 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] HTTP exception thrown: Instance 903d1b05-7ed1-4b57-9325-7671d72d4284 could not be found. May 31 21:20:02.887577 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-fa5269df-7bc5-4606-816d-c38eef305079 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Request method failure captured: May 31 21:20:02.887577 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: request: GET /compute/v2.1/servers/903d1b05-7ed1-4b57-9325-7671d72d4284 HTTP/1.1 May 31 21:20:02.887577 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Accept: application/json May 31 21:20:02.887577 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Accept-Encoding: identity May 31 21:20:02.887577 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Connection: close May 31 21:20:02.887577 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Content-Length: 0 May 31 21:20:02.887577 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Content-Type: application/json May 31 21:20:02.887577 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Host: 10.222.0.55 May 31 21:20:02.887577 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Openstack-System-Scope: None May 31 21:20:02.887577 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: User-Agent: python-urllib3/1.26.9 May 31 21:20:02.887577 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Auth-Token: gAAAAABiloR6qg65df265xnXkf0TY6yHSXRv8NS86FmUnFNzjk_pCIOLgrgfJbkxmZYFC66OdFLRA4PHOQ2UiyK6Br4eaixrZ-5NlYmO2AXCMbb_Qo66xtWpyddhdAMGxddxV67OHhRmLW9fy2wijnAPzU9Ur_Oi62eu23Z9lUdWg-uvkw7ldZA May 31 21:20:02.887577 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Domain-Id: None May 31 21:20:02.887577 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Domain-Name: None May 31 21:20:02.887577 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Identity-Status: Confirmed May 31 21:20:02.887577 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Is-Admin-Project: True May 31 21:20:02.887577 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Domain-Id: default May 31 21:20:02.887577 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Domain-Name: Default May 31 21:20:02.887577 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Id: 69b2364f40d14160adf0220d92adaad7 May 31 21:20:02.887577 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Name: tempest-AttachVolumeNegativeTest-14232740 May 31 21:20:02.887577 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Role: member,reader May 31 21:20:02.887577 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Roles: member,reader May 31 21:20:02.890215 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/69b2364f40d14160adf0220d92adaad7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/69b2364f40d14160adf0220d92adaad7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_69b2364f40d14160adf0220d92adaad7", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/69b2364f40d14160adf0220d92adaad7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] May 31 21:20:02.890215 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant: tempest-AttachVolumeNegativeTest-14232740 May 31 21:20:02.890215 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant-Id: 69b2364f40d14160adf0220d92adaad7 May 31 21:20:02.890215 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-14232740 May 31 21:20:02.890215 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User: tempest-AttachVolumeNegativeTest-14232740-project May 31 21:20:02.890215 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Domain-Id: default May 31 21:20:02.890215 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Domain-Name: Default May 31 21:20:02.890215 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Id: 8efe37a6d57b4775b4e47a295c3f5eee May 31 21:20:02.890215 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Name: tempest-AttachVolumeNegativeTest-14232740-project May 31 21:20:02.890215 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: method: > May 31 21:20:02.890215 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: exception: Instance 903d1b05-7ed1-4b57-9325-7671d72d4284 could not be found. May 31 21:20:02.890215 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: action_args: {'id': '903d1b05-7ed1-4b57-9325-7671d72d4284'} May 31 21:20:02.891218 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 21:20:02.891218 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:20:02.891218 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 21:20:02.891218 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 21:20:02.891218 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 21:20:02.891218 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 21:20:02.891218 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 21:20:02.891218 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 21:20:02.891218 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 21:20:02.891218 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 21:20:02.891218 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 903d1b05-7ed1-4b57-9325-7671d72d4284 could not be found. May 31 21:20:02.891218 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:20:02.891218 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:20:02.891218 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:20:02.891218 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:20:02.891218 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:20:02.891218 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:20:02.891218 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 21:20:02.891218 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 21:20:02.891218 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 21:20:02.892848 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 21:20:02.892848 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 21:20:02.892848 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 21:20:02.892848 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 21:20:02.892848 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 21:20:02.892848 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 21:20:02.892848 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 21:20:02.892848 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 903d1b05-7ed1-4b57-9325-7671d72d4284 could not be found. May 31 21:20:02.892848 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:20:02.892848 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:20:02.892848 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:20:02.892848 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:20:02.892848 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:20:02.892848 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:20:02.892848 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 21:20:02.892848 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 21:20:02.892848 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 903d1b05-7ed1-4b57-9325-7671d72d4284 could not be found. May 31 21:20:02.892848 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:20:02.894624 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-fa5269df-7bc5-4606-816d-c38eef305079 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Returning 404 to user: Instance 903d1b05-7ed1-4b57-9325-7671d72d4284 could not be found. {{(pid=118185) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 21:20:02.894624 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-fa5269df-7bc5-4606-816d-c38eef305079 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/903d1b05-7ed1-4b57-9325-7671d72d4284" status: 404 len: 111 microversion: 2.1 time: 0.030546 May 31 21:20:02.894624 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 618/1256] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:20:02 2022] GET /compute/v2.1/servers/903d1b05-7ed1-4b57-9325-7671d72d4284 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 21:20:02.904483 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-6a14146a-7788-416c-b513-db9bd21662e4 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '.version_select at 0x7fe7c5f03af0>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:20:03.019789 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-6a14146a-7788-416c-b513-db9bd21662e4 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1009125788" status: 202 len: 0 microversion: 2.1 time: 0.123266 May 31 21:20:03.020376 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 639/1257] 10.222.0.55 () {58 vars in 1220 bytes} [Tue May 31 21:20:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1009125788 => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 21:20:05.005524 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-2d35d9b9-207b-49c8-ba4b-c366fd1c330d tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:20:05.006051 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-2d35d9b9-207b-49c8-ba4b-c366fd1c330d tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 903d1b05-7ed1-4b57-9325-7671d72d4284] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:20:05.013087 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-2d35d9b9-207b-49c8-ba4b-c366fd1c330d tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:20:05.013532 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-2d35d9b9-207b-49c8-ba4b-c366fd1c330d tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:20:05.014322 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-2d35d9b9-207b-49c8-ba4b-c366fd1c330d tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:20:05.014759 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-2d35d9b9-207b-49c8-ba4b-c366fd1c330d tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:20:05.028390 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.wsgi [None req-2d35d9b9-207b-49c8-ba4b-c366fd1c330d tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] HTTP exception thrown: Instance 903d1b05-7ed1-4b57-9325-7671d72d4284 could not be found. May 31 21:20:05.029990 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-2d35d9b9-207b-49c8-ba4b-c366fd1c330d tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Request method failure captured: May 31 21:20:05.029990 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: request: DELETE /compute/v2.1/servers/903d1b05-7ed1-4b57-9325-7671d72d4284 HTTP/1.1 May 31 21:20:05.029990 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Accept: application/json May 31 21:20:05.029990 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Accept-Encoding: identity May 31 21:20:05.029990 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Connection: close May 31 21:20:05.029990 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Content-Length: 0 May 31 21:20:05.029990 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Content-Type: application/json May 31 21:20:05.029990 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Host: 10.222.0.55 May 31 21:20:05.029990 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Openstack-System-Scope: None May 31 21:20:05.029990 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: User-Agent: python-urllib3/1.26.9 May 31 21:20:05.029990 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Auth-Token: gAAAAABiloR6qg65df265xnXkf0TY6yHSXRv8NS86FmUnFNzjk_pCIOLgrgfJbkxmZYFC66OdFLRA4PHOQ2UiyK6Br4eaixrZ-5NlYmO2AXCMbb_Qo66xtWpyddhdAMGxddxV67OHhRmLW9fy2wijnAPzU9Ur_Oi62eu23Z9lUdWg-uvkw7ldZA May 31 21:20:05.029990 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Domain-Id: None May 31 21:20:05.029990 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Domain-Name: None May 31 21:20:05.029990 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Identity-Status: Confirmed May 31 21:20:05.029990 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Is-Admin-Project: True May 31 21:20:05.029990 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Domain-Id: default May 31 21:20:05.029990 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Domain-Name: Default May 31 21:20:05.029990 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Id: 69b2364f40d14160adf0220d92adaad7 May 31 21:20:05.029990 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Name: tempest-AttachVolumeNegativeTest-14232740 May 31 21:20:05.029990 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Role: member,reader May 31 21:20:05.029990 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Roles: member,reader May 31 21:20:05.031629 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/69b2364f40d14160adf0220d92adaad7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/69b2364f40d14160adf0220d92adaad7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_69b2364f40d14160adf0220d92adaad7", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/69b2364f40d14160adf0220d92adaad7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] May 31 21:20:05.031629 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant: tempest-AttachVolumeNegativeTest-14232740 May 31 21:20:05.031629 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant-Id: 69b2364f40d14160adf0220d92adaad7 May 31 21:20:05.031629 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-14232740 May 31 21:20:05.031629 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User: tempest-AttachVolumeNegativeTest-14232740-project May 31 21:20:05.031629 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Domain-Id: default May 31 21:20:05.031629 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Domain-Name: Default May 31 21:20:05.031629 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Id: 8efe37a6d57b4775b4e47a295c3f5eee May 31 21:20:05.031629 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Name: tempest-AttachVolumeNegativeTest-14232740-project May 31 21:20:05.031629 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: method: > May 31 21:20:05.031629 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: exception: Instance 903d1b05-7ed1-4b57-9325-7671d72d4284 could not be found. May 31 21:20:05.031629 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: action_args: {'id': '903d1b05-7ed1-4b57-9325-7671d72d4284'} May 31 21:20:05.032452 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 21:20:05.032452 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:20:05.032452 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 21:20:05.032452 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 21:20:05.032452 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 21:20:05.032452 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 21:20:05.032452 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 21:20:05.032452 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 21:20:05.032452 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 21:20:05.032452 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 21:20:05.032452 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 903d1b05-7ed1-4b57-9325-7671d72d4284 could not be found. May 31 21:20:05.032452 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:20:05.032452 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:20:05.032452 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:20:05.032452 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:20:05.032452 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:20:05.032452 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:20:05.032452 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 21:20:05.032452 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 21:20:05.032452 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 21:20:05.034220 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 21:20:05.034220 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 31 21:20:05.034220 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 31 21:20:05.034220 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 31 21:20:05.034220 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 31 21:20:05.034220 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 21:20:05.034220 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 21:20:05.034220 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 21:20:05.034220 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 21:20:05.034220 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 903d1b05-7ed1-4b57-9325-7671d72d4284 could not be found. May 31 21:20:05.034220 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:20:05.034220 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:20:05.034220 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:20:05.034220 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:20:05.034220 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:20:05.034220 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:20:05.034220 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 21:20:05.034220 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 21:20:05.034220 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 903d1b05-7ed1-4b57-9325-7671d72d4284 could not be found. May 31 21:20:05.034220 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:20:05.035874 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-2d35d9b9-207b-49c8-ba4b-c366fd1c330d tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Returning 404 to user: Instance 903d1b05-7ed1-4b57-9325-7671d72d4284 could not be found. {{(pid=118185) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 21:20:05.035874 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-2d35d9b9-207b-49c8-ba4b-c366fd1c330d tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "DELETE /compute/v2.1/servers/903d1b05-7ed1-4b57-9325-7671d72d4284" status: 404 len: 111 microversion: 2.1 time: 0.029635 May 31 21:20:05.035874 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 619/1258] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 31 21:20:05 2022] DELETE /compute/v2.1/servers/903d1b05-7ed1-4b57-9325-7671d72d4284 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 21:20:05.040201 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-0a7d3dd9-1b36-496f-8d19-32a5cb13a3d3 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:20:05.040932 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-0a7d3dd9-1b36-496f-8d19-32a5cb13a3d3 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 903d1b05-7ed1-4b57-9325-7671d72d4284] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:20:05.047132 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-0a7d3dd9-1b36-496f-8d19-32a5cb13a3d3 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:20:05.047526 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-0a7d3dd9-1b36-496f-8d19-32a5cb13a3d3 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:20:05.048288 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-0a7d3dd9-1b36-496f-8d19-32a5cb13a3d3 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:20:05.049561 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-0a7d3dd9-1b36-496f-8d19-32a5cb13a3d3 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:20:05.062595 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.wsgi [None req-0a7d3dd9-1b36-496f-8d19-32a5cb13a3d3 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] HTTP exception thrown: Instance 903d1b05-7ed1-4b57-9325-7671d72d4284 could not be found. May 31 21:20:05.064203 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-0a7d3dd9-1b36-496f-8d19-32a5cb13a3d3 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Request method failure captured: May 31 21:20:05.064203 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: request: GET /compute/v2.1/servers/903d1b05-7ed1-4b57-9325-7671d72d4284 HTTP/1.1 May 31 21:20:05.064203 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Accept: application/json May 31 21:20:05.064203 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Accept-Encoding: identity May 31 21:20:05.064203 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Connection: close May 31 21:20:05.064203 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Content-Length: 0 May 31 21:20:05.064203 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Content-Type: application/json May 31 21:20:05.064203 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Host: 10.222.0.55 May 31 21:20:05.064203 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Openstack-System-Scope: None May 31 21:20:05.064203 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: User-Agent: python-urllib3/1.26.9 May 31 21:20:05.064203 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Auth-Token: gAAAAABiloR6qg65df265xnXkf0TY6yHSXRv8NS86FmUnFNzjk_pCIOLgrgfJbkxmZYFC66OdFLRA4PHOQ2UiyK6Br4eaixrZ-5NlYmO2AXCMbb_Qo66xtWpyddhdAMGxddxV67OHhRmLW9fy2wijnAPzU9Ur_Oi62eu23Z9lUdWg-uvkw7ldZA May 31 21:20:05.064203 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Domain-Id: None May 31 21:20:05.064203 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Domain-Name: None May 31 21:20:05.064203 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Identity-Status: Confirmed May 31 21:20:05.064203 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Is-Admin-Project: True May 31 21:20:05.064203 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Domain-Id: default May 31 21:20:05.064203 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Domain-Name: Default May 31 21:20:05.064203 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Id: 69b2364f40d14160adf0220d92adaad7 May 31 21:20:05.064203 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Name: tempest-AttachVolumeNegativeTest-14232740 May 31 21:20:05.064203 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Role: member,reader May 31 21:20:05.064203 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Roles: member,reader May 31 21:20:05.065835 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/69b2364f40d14160adf0220d92adaad7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/69b2364f40d14160adf0220d92adaad7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_69b2364f40d14160adf0220d92adaad7", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/69b2364f40d14160adf0220d92adaad7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] May 31 21:20:05.065835 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant: tempest-AttachVolumeNegativeTest-14232740 May 31 21:20:05.065835 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant-Id: 69b2364f40d14160adf0220d92adaad7 May 31 21:20:05.065835 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-14232740 May 31 21:20:05.065835 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User: tempest-AttachVolumeNegativeTest-14232740-project May 31 21:20:05.065835 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Domain-Id: default May 31 21:20:05.065835 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Domain-Name: Default May 31 21:20:05.065835 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Id: 8efe37a6d57b4775b4e47a295c3f5eee May 31 21:20:05.065835 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Name: tempest-AttachVolumeNegativeTest-14232740-project May 31 21:20:05.065835 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: method: > May 31 21:20:05.065835 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: exception: Instance 903d1b05-7ed1-4b57-9325-7671d72d4284 could not be found. May 31 21:20:05.065835 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: action_args: {'id': '903d1b05-7ed1-4b57-9325-7671d72d4284'} May 31 21:20:05.071443 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 21:20:05.071443 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:20:05.071443 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 21:20:05.071443 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 21:20:05.071443 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 21:20:05.071443 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 21:20:05.071443 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 21:20:05.071443 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 21:20:05.071443 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 21:20:05.071443 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 21:20:05.071443 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 903d1b05-7ed1-4b57-9325-7671d72d4284 could not be found. May 31 21:20:05.071443 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:20:05.071443 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:20:05.071443 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:20:05.071443 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:20:05.071443 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:20:05.071443 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:20:05.071443 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 21:20:05.071443 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 21:20:05.071443 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 21:20:05.072941 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 21:20:05.072941 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 21:20:05.072941 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 21:20:05.072941 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 21:20:05.072941 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 21:20:05.072941 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 21:20:05.072941 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 21:20:05.072941 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 903d1b05-7ed1-4b57-9325-7671d72d4284 could not be found. May 31 21:20:05.072941 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:20:05.072941 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:20:05.072941 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:20:05.072941 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:20:05.072941 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:20:05.072941 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:20:05.072941 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 21:20:05.072941 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 21:20:05.072941 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 903d1b05-7ed1-4b57-9325-7671d72d4284 could not be found. May 31 21:20:05.072941 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:20:05.074297 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-0a7d3dd9-1b36-496f-8d19-32a5cb13a3d3 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Returning 404 to user: Instance 903d1b05-7ed1-4b57-9325-7671d72d4284 could not be found. {{(pid=118184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 21:20:05.074297 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-0a7d3dd9-1b36-496f-8d19-32a5cb13a3d3 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/903d1b05-7ed1-4b57-9325-7671d72d4284" status: 404 len: 111 microversion: 2.1 time: 0.029694 May 31 21:20:05.074297 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 640/1259] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:20:05 2022] GET /compute/v2.1/servers/903d1b05-7ed1-4b57-9325-7671d72d4284 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 21:20:06.339586 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-9397d869-c73f-48a6-b8ea-714ce2f3ed6c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:20:06.340081 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-9397d869-c73f-48a6-b8ea-714ce2f3ed6c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: cd8f2486-d4cf-40d9-9a07-d12933c0923b] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:20:06.346541 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9397d869-c73f-48a6-b8ea-714ce2f3ed6c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:20:06.346990 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9397d869-c73f-48a6-b8ea-714ce2f3ed6c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:20:06.347748 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9397d869-c73f-48a6-b8ea-714ce2f3ed6c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:20:06.348189 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-9397d869-c73f-48a6-b8ea-714ce2f3ed6c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:20:06.361045 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.wsgi [None req-9397d869-c73f-48a6-b8ea-714ce2f3ed6c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] HTTP exception thrown: Instance cd8f2486-d4cf-40d9-9a07-d12933c0923b could not be found. May 31 21:20:06.362582 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-9397d869-c73f-48a6-b8ea-714ce2f3ed6c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Request method failure captured: May 31 21:20:06.362582 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: request: DELETE /compute/v2.1/servers/cd8f2486-d4cf-40d9-9a07-d12933c0923b HTTP/1.1 May 31 21:20:06.362582 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Accept: application/json May 31 21:20:06.362582 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Accept-Encoding: identity May 31 21:20:06.362582 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Connection: close May 31 21:20:06.362582 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Content-Length: 0 May 31 21:20:06.362582 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Content-Type: application/json May 31 21:20:06.362582 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Host: 10.222.0.55 May 31 21:20:06.362582 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Openstack-System-Scope: None May 31 21:20:06.362582 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: User-Agent: python-urllib3/1.26.9 May 31 21:20:06.362582 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Auth-Token: gAAAAABiloR6qg65df265xnXkf0TY6yHSXRv8NS86FmUnFNzjk_pCIOLgrgfJbkxmZYFC66OdFLRA4PHOQ2UiyK6Br4eaixrZ-5NlYmO2AXCMbb_Qo66xtWpyddhdAMGxddxV67OHhRmLW9fy2wijnAPzU9Ur_Oi62eu23Z9lUdWg-uvkw7ldZA May 31 21:20:06.362582 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Domain-Id: None May 31 21:20:06.362582 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Domain-Name: None May 31 21:20:06.362582 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Identity-Status: Confirmed May 31 21:20:06.362582 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Is-Admin-Project: True May 31 21:20:06.362582 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Domain-Id: default May 31 21:20:06.362582 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Domain-Name: Default May 31 21:20:06.362582 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Id: 69b2364f40d14160adf0220d92adaad7 May 31 21:20:06.362582 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Name: tempest-AttachVolumeNegativeTest-14232740 May 31 21:20:06.362582 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Role: member,reader May 31 21:20:06.362582 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Roles: member,reader May 31 21:20:06.364171 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/69b2364f40d14160adf0220d92adaad7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/69b2364f40d14160adf0220d92adaad7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_69b2364f40d14160adf0220d92adaad7", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/69b2364f40d14160adf0220d92adaad7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] May 31 21:20:06.364171 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant: tempest-AttachVolumeNegativeTest-14232740 May 31 21:20:06.364171 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant-Id: 69b2364f40d14160adf0220d92adaad7 May 31 21:20:06.364171 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-14232740 May 31 21:20:06.364171 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User: tempest-AttachVolumeNegativeTest-14232740-project May 31 21:20:06.364171 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Domain-Id: default May 31 21:20:06.364171 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Domain-Name: Default May 31 21:20:06.364171 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Id: 8efe37a6d57b4775b4e47a295c3f5eee May 31 21:20:06.364171 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Name: tempest-AttachVolumeNegativeTest-14232740-project May 31 21:20:06.364171 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: method: > May 31 21:20:06.364171 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: exception: Instance cd8f2486-d4cf-40d9-9a07-d12933c0923b could not be found. May 31 21:20:06.364171 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: action_args: {'id': 'cd8f2486-d4cf-40d9-9a07-d12933c0923b'} May 31 21:20:06.365080 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 21:20:06.365080 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:20:06.365080 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 21:20:06.365080 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 21:20:06.365080 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 21:20:06.365080 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 21:20:06.365080 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 21:20:06.365080 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 21:20:06.365080 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 21:20:06.365080 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 21:20:06.365080 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd8f2486-d4cf-40d9-9a07-d12933c0923b could not be found. May 31 21:20:06.365080 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:20:06.365080 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:20:06.365080 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:20:06.365080 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:20:06.365080 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:20:06.365080 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:20:06.365080 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 21:20:06.365080 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 21:20:06.365080 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 21:20:06.366604 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 21:20:06.366604 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 31 21:20:06.366604 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 31 21:20:06.366604 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 31 21:20:06.366604 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 31 21:20:06.366604 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 21:20:06.366604 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 21:20:06.366604 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 21:20:06.366604 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 21:20:06.366604 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd8f2486-d4cf-40d9-9a07-d12933c0923b could not be found. May 31 21:20:06.366604 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:20:06.366604 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:20:06.366604 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:20:06.366604 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:20:06.366604 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:20:06.366604 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:20:06.366604 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 21:20:06.366604 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 21:20:06.366604 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd8f2486-d4cf-40d9-9a07-d12933c0923b could not be found. May 31 21:20:06.366604 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:20:06.368093 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-9397d869-c73f-48a6-b8ea-714ce2f3ed6c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Returning 404 to user: Instance cd8f2486-d4cf-40d9-9a07-d12933c0923b could not be found. {{(pid=118185) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 21:20:06.368093 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-9397d869-c73f-48a6-b8ea-714ce2f3ed6c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "DELETE /compute/v2.1/servers/cd8f2486-d4cf-40d9-9a07-d12933c0923b" status: 404 len: 111 microversion: 2.1 time: 0.028869 May 31 21:20:06.368093 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 620/1260] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 31 21:20:06 2022] DELETE /compute/v2.1/servers/cd8f2486-d4cf-40d9-9a07-d12933c0923b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 21:20:06.372241 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-852c8f8a-29f3-4451-bc23-8f49ba59944c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:20:06.372891 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-852c8f8a-29f3-4451-bc23-8f49ba59944c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: cd8f2486-d4cf-40d9-9a07-d12933c0923b] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:20:06.379278 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-852c8f8a-29f3-4451-bc23-8f49ba59944c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:20:06.379727 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-852c8f8a-29f3-4451-bc23-8f49ba59944c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:20:06.380487 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-852c8f8a-29f3-4451-bc23-8f49ba59944c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:20:06.380926 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-852c8f8a-29f3-4451-bc23-8f49ba59944c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:20:06.394656 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.wsgi [None req-852c8f8a-29f3-4451-bc23-8f49ba59944c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] HTTP exception thrown: Instance cd8f2486-d4cf-40d9-9a07-d12933c0923b could not be found. May 31 21:20:06.396174 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-852c8f8a-29f3-4451-bc23-8f49ba59944c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Request method failure captured: May 31 21:20:06.396174 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: request: GET /compute/v2.1/servers/cd8f2486-d4cf-40d9-9a07-d12933c0923b HTTP/1.1 May 31 21:20:06.396174 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Accept: application/json May 31 21:20:06.396174 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Accept-Encoding: identity May 31 21:20:06.396174 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Connection: close May 31 21:20:06.396174 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Content-Length: 0 May 31 21:20:06.396174 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Content-Type: application/json May 31 21:20:06.396174 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Host: 10.222.0.55 May 31 21:20:06.396174 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Openstack-System-Scope: None May 31 21:20:06.396174 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: User-Agent: python-urllib3/1.26.9 May 31 21:20:06.396174 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Auth-Token: gAAAAABiloR6qg65df265xnXkf0TY6yHSXRv8NS86FmUnFNzjk_pCIOLgrgfJbkxmZYFC66OdFLRA4PHOQ2UiyK6Br4eaixrZ-5NlYmO2AXCMbb_Qo66xtWpyddhdAMGxddxV67OHhRmLW9fy2wijnAPzU9Ur_Oi62eu23Z9lUdWg-uvkw7ldZA May 31 21:20:06.396174 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Domain-Id: None May 31 21:20:06.396174 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Domain-Name: None May 31 21:20:06.396174 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Identity-Status: Confirmed May 31 21:20:06.396174 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Is-Admin-Project: True May 31 21:20:06.396174 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Domain-Id: default May 31 21:20:06.396174 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Domain-Name: Default May 31 21:20:06.396174 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Id: 69b2364f40d14160adf0220d92adaad7 May 31 21:20:06.396174 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Name: tempest-AttachVolumeNegativeTest-14232740 May 31 21:20:06.396174 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Role: member,reader May 31 21:20:06.396174 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Roles: member,reader May 31 21:20:06.397740 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/69b2364f40d14160adf0220d92adaad7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/69b2364f40d14160adf0220d92adaad7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_69b2364f40d14160adf0220d92adaad7", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/69b2364f40d14160adf0220d92adaad7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] May 31 21:20:06.397740 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant: tempest-AttachVolumeNegativeTest-14232740 May 31 21:20:06.397740 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant-Id: 69b2364f40d14160adf0220d92adaad7 May 31 21:20:06.397740 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-14232740 May 31 21:20:06.397740 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User: tempest-AttachVolumeNegativeTest-14232740-project May 31 21:20:06.397740 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Domain-Id: default May 31 21:20:06.397740 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Domain-Name: Default May 31 21:20:06.397740 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Id: 8efe37a6d57b4775b4e47a295c3f5eee May 31 21:20:06.397740 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Name: tempest-AttachVolumeNegativeTest-14232740-project May 31 21:20:06.397740 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: method: > May 31 21:20:06.397740 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: exception: Instance cd8f2486-d4cf-40d9-9a07-d12933c0923b could not be found. May 31 21:20:06.397740 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: action_args: {'id': 'cd8f2486-d4cf-40d9-9a07-d12933c0923b'} May 31 21:20:06.398757 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 21:20:06.398757 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:20:06.398757 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 21:20:06.398757 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 21:20:06.398757 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 21:20:06.398757 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 21:20:06.398757 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 21:20:06.398757 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 21:20:06.398757 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 21:20:06.398757 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 21:20:06.398757 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd8f2486-d4cf-40d9-9a07-d12933c0923b could not be found. May 31 21:20:06.398757 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:20:06.398757 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:20:06.398757 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:20:06.398757 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:20:06.398757 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:20:06.398757 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:20:06.398757 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 21:20:06.398757 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 21:20:06.398757 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 21:20:06.400816 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 21:20:06.400816 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 21:20:06.400816 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 21:20:06.400816 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 21:20:06.400816 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 21:20:06.400816 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 21:20:06.400816 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 21:20:06.400816 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd8f2486-d4cf-40d9-9a07-d12933c0923b could not be found. May 31 21:20:06.400816 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:20:06.400816 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:20:06.400816 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:20:06.400816 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:20:06.400816 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:20:06.400816 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:20:06.400816 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 21:20:06.400816 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 21:20:06.400816 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd8f2486-d4cf-40d9-9a07-d12933c0923b could not be found. May 31 21:20:06.400816 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:20:06.402125 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-852c8f8a-29f3-4451-bc23-8f49ba59944c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Returning 404 to user: Instance cd8f2486-d4cf-40d9-9a07-d12933c0923b could not be found. {{(pid=118184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 21:20:06.402125 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-852c8f8a-29f3-4451-bc23-8f49ba59944c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/cd8f2486-d4cf-40d9-9a07-d12933c0923b" status: 404 len: 111 microversion: 2.1 time: 0.029215 May 31 21:20:06.402125 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 641/1261] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:20:06 2022] GET /compute/v2.1/servers/cd8f2486-d4cf-40d9-9a07-d12933c0923b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 21:20:06.406739 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-77c16f0e-e47e-4f5a-866d-508d23cf0372 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:20:06.416976 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-77c16f0e-e47e-4f5a-866d-508d23cf0372 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:20:06.416976 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-77c16f0e-e47e-4f5a-866d-508d23cf0372 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:20:06.416976 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-77c16f0e-e47e-4f5a-866d-508d23cf0372 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:20:06.416976 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-77c16f0e-e47e-4f5a-866d-508d23cf0372 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:20:06.417470 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-77c16f0e-e47e-4f5a-866d-508d23cf0372 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:20:06.428164 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.wsgi [None req-77c16f0e-e47e-4f5a-866d-508d23cf0372 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] HTTP exception thrown: Instance 5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982 could not be found. May 31 21:20:06.429729 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-77c16f0e-e47e-4f5a-866d-508d23cf0372 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Request method failure captured: May 31 21:20:06.429729 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: request: DELETE /compute/v2.1/servers/5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982 HTTP/1.1 May 31 21:20:06.429729 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Accept: application/json May 31 21:20:06.429729 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Accept-Encoding: identity May 31 21:20:06.429729 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Connection: close May 31 21:20:06.429729 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Content-Length: 0 May 31 21:20:06.429729 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Content-Type: application/json May 31 21:20:06.429729 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Host: 10.222.0.55 May 31 21:20:06.429729 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Openstack-System-Scope: None May 31 21:20:06.429729 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: User-Agent: python-urllib3/1.26.9 May 31 21:20:06.429729 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Auth-Token: gAAAAABiloR6qg65df265xnXkf0TY6yHSXRv8NS86FmUnFNzjk_pCIOLgrgfJbkxmZYFC66OdFLRA4PHOQ2UiyK6Br4eaixrZ-5NlYmO2AXCMbb_Qo66xtWpyddhdAMGxddxV67OHhRmLW9fy2wijnAPzU9Ur_Oi62eu23Z9lUdWg-uvkw7ldZA May 31 21:20:06.429729 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Domain-Id: None May 31 21:20:06.429729 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Domain-Name: None May 31 21:20:06.429729 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Identity-Status: Confirmed May 31 21:20:06.429729 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Is-Admin-Project: True May 31 21:20:06.429729 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Domain-Id: default May 31 21:20:06.429729 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Domain-Name: Default May 31 21:20:06.429729 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Id: 69b2364f40d14160adf0220d92adaad7 May 31 21:20:06.429729 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Name: tempest-AttachVolumeNegativeTest-14232740 May 31 21:20:06.429729 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Role: member,reader May 31 21:20:06.429729 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Roles: member,reader May 31 21:20:06.431331 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/69b2364f40d14160adf0220d92adaad7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/69b2364f40d14160adf0220d92adaad7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_69b2364f40d14160adf0220d92adaad7", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/69b2364f40d14160adf0220d92adaad7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] May 31 21:20:06.431331 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant: tempest-AttachVolumeNegativeTest-14232740 May 31 21:20:06.431331 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant-Id: 69b2364f40d14160adf0220d92adaad7 May 31 21:20:06.431331 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-14232740 May 31 21:20:06.431331 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User: tempest-AttachVolumeNegativeTest-14232740-project May 31 21:20:06.431331 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Domain-Id: default May 31 21:20:06.431331 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Domain-Name: Default May 31 21:20:06.431331 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Id: 8efe37a6d57b4775b4e47a295c3f5eee May 31 21:20:06.431331 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Name: tempest-AttachVolumeNegativeTest-14232740-project May 31 21:20:06.431331 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: method: > May 31 21:20:06.431331 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: exception: Instance 5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982 could not be found. May 31 21:20:06.431331 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: action_args: {'id': '5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982'} May 31 21:20:06.432151 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 21:20:06.432151 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:20:06.432151 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 21:20:06.432151 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 21:20:06.432151 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 21:20:06.432151 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 21:20:06.432151 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 21:20:06.432151 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 21:20:06.432151 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 21:20:06.432151 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 21:20:06.432151 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982 could not be found. May 31 21:20:06.432151 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:20:06.432151 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:20:06.432151 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:20:06.432151 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:20:06.432151 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:20:06.432151 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:20:06.432151 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 21:20:06.432151 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 21:20:06.432151 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 21:20:06.433573 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 21:20:06.433573 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 31 21:20:06.433573 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 31 21:20:06.433573 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 31 21:20:06.433573 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 31 21:20:06.433573 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 21:20:06.433573 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 21:20:06.433573 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 21:20:06.433573 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 21:20:06.433573 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982 could not be found. May 31 21:20:06.433573 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:20:06.433573 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:20:06.433573 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:20:06.433573 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:20:06.433573 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:20:06.433573 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:20:06.433573 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 21:20:06.433573 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 21:20:06.433573 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982 could not be found. May 31 21:20:06.433573 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:20:06.436161 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-77c16f0e-e47e-4f5a-866d-508d23cf0372 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Returning 404 to user: Instance 5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982 could not be found. {{(pid=118185) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 21:20:06.436161 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-77c16f0e-e47e-4f5a-866d-508d23cf0372 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "DELETE /compute/v2.1/servers/5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982" status: 404 len: 111 microversion: 2.1 time: 0.028268 May 31 21:20:06.436161 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 621/1262] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 31 21:20:06 2022] DELETE /compute/v2.1/servers/5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 21:20:06.440652 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-e973491f-73b4-4c86-8033-d10fcdca9212 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:20:06.441402 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-e973491f-73b4-4c86-8033-d10fcdca9212 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:20:06.448263 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e973491f-73b4-4c86-8033-d10fcdca9212 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:20:06.448716 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e973491f-73b4-4c86-8033-d10fcdca9212 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:20:06.449476 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e973491f-73b4-4c86-8033-d10fcdca9212 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:20:06.449941 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-e973491f-73b4-4c86-8033-d10fcdca9212 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:20:06.464009 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.wsgi [None req-e973491f-73b4-4c86-8033-d10fcdca9212 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] HTTP exception thrown: Instance 5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982 could not be found. May 31 21:20:06.465551 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-e973491f-73b4-4c86-8033-d10fcdca9212 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Request method failure captured: May 31 21:20:06.465551 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: request: GET /compute/v2.1/servers/5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982 HTTP/1.1 May 31 21:20:06.465551 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Accept: application/json May 31 21:20:06.465551 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Accept-Encoding: identity May 31 21:20:06.465551 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Connection: close May 31 21:20:06.465551 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Content-Length: 0 May 31 21:20:06.465551 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Content-Type: application/json May 31 21:20:06.465551 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Host: 10.222.0.55 May 31 21:20:06.465551 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Openstack-System-Scope: None May 31 21:20:06.465551 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: User-Agent: python-urllib3/1.26.9 May 31 21:20:06.465551 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Auth-Token: gAAAAABiloR6qg65df265xnXkf0TY6yHSXRv8NS86FmUnFNzjk_pCIOLgrgfJbkxmZYFC66OdFLRA4PHOQ2UiyK6Br4eaixrZ-5NlYmO2AXCMbb_Qo66xtWpyddhdAMGxddxV67OHhRmLW9fy2wijnAPzU9Ur_Oi62eu23Z9lUdWg-uvkw7ldZA May 31 21:20:06.465551 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Domain-Id: None May 31 21:20:06.465551 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Domain-Name: None May 31 21:20:06.465551 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Identity-Status: Confirmed May 31 21:20:06.465551 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Is-Admin-Project: True May 31 21:20:06.465551 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Domain-Id: default May 31 21:20:06.465551 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Domain-Name: Default May 31 21:20:06.465551 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Id: 69b2364f40d14160adf0220d92adaad7 May 31 21:20:06.465551 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Name: tempest-AttachVolumeNegativeTest-14232740 May 31 21:20:06.465551 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Role: member,reader May 31 21:20:06.465551 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Roles: member,reader May 31 21:20:06.467332 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/69b2364f40d14160adf0220d92adaad7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/69b2364f40d14160adf0220d92adaad7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_69b2364f40d14160adf0220d92adaad7", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/69b2364f40d14160adf0220d92adaad7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] May 31 21:20:06.467332 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant: tempest-AttachVolumeNegativeTest-14232740 May 31 21:20:06.467332 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant-Id: 69b2364f40d14160adf0220d92adaad7 May 31 21:20:06.467332 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-14232740 May 31 21:20:06.467332 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User: tempest-AttachVolumeNegativeTest-14232740-project May 31 21:20:06.467332 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Domain-Id: default May 31 21:20:06.467332 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Domain-Name: Default May 31 21:20:06.467332 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Id: 8efe37a6d57b4775b4e47a295c3f5eee May 31 21:20:06.467332 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Name: tempest-AttachVolumeNegativeTest-14232740-project May 31 21:20:06.467332 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: method: > May 31 21:20:06.467332 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: exception: Instance 5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982 could not be found. May 31 21:20:06.467332 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: action_args: {'id': '5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982'} May 31 21:20:06.468344 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 21:20:06.468344 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:20:06.468344 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 21:20:06.468344 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 21:20:06.468344 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 21:20:06.468344 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 21:20:06.468344 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 21:20:06.468344 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 21:20:06.468344 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 21:20:06.468344 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 21:20:06.468344 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982 could not be found. May 31 21:20:06.468344 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:20:06.468344 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:20:06.468344 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:20:06.468344 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:20:06.468344 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:20:06.468344 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:20:06.468344 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 21:20:06.468344 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 21:20:06.468344 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 21:20:06.470118 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 21:20:06.470118 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 21:20:06.470118 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 21:20:06.470118 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 21:20:06.470118 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 21:20:06.470118 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 21:20:06.470118 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 21:20:06.470118 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982 could not be found. May 31 21:20:06.470118 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:20:06.470118 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:20:06.470118 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:20:06.470118 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:20:06.470118 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:20:06.470118 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:20:06.470118 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 21:20:06.470118 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 21:20:06.470118 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982 could not be found. May 31 21:20:06.470118 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:20:06.471734 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-e973491f-73b4-4c86-8033-d10fcdca9212 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Returning 404 to user: Instance 5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982 could not be found. {{(pid=118184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 21:20:06.471734 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-e973491f-73b4-4c86-8033-d10fcdca9212 tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982" status: 404 len: 111 microversion: 2.1 time: 0.030240 May 31 21:20:06.471734 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 642/1263] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:20:06 2022] GET /compute/v2.1/servers/5f3dbd3d-5eee-41a4-8cf7-9ae611ed5982 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 21:20:07.686401 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-c584309e-1afd-4b46-9458-e2365cdfca3c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:20:07.686902 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-c584309e-1afd-4b46-9458-e2365cdfca3c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 5cb669a7-8e63-46ac-86f6-1be4050a44ec] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:20:07.693389 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c584309e-1afd-4b46-9458-e2365cdfca3c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:20:07.693834 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c584309e-1afd-4b46-9458-e2365cdfca3c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:20:07.694619 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c584309e-1afd-4b46-9458-e2365cdfca3c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:20:07.695391 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-c584309e-1afd-4b46-9458-e2365cdfca3c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:20:07.708797 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.wsgi [None req-c584309e-1afd-4b46-9458-e2365cdfca3c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] HTTP exception thrown: Instance 5cb669a7-8e63-46ac-86f6-1be4050a44ec could not be found. May 31 21:20:07.710365 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-c584309e-1afd-4b46-9458-e2365cdfca3c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Request method failure captured: May 31 21:20:07.710365 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: request: DELETE /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec HTTP/1.1 May 31 21:20:07.710365 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Accept: application/json May 31 21:20:07.710365 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Accept-Encoding: identity May 31 21:20:07.710365 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Connection: close May 31 21:20:07.710365 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Content-Length: 0 May 31 21:20:07.710365 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Content-Type: application/json May 31 21:20:07.710365 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Host: 10.222.0.55 May 31 21:20:07.710365 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Openstack-System-Scope: None May 31 21:20:07.710365 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: User-Agent: python-urllib3/1.26.9 May 31 21:20:07.710365 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Auth-Token: gAAAAABiloR6qg65df265xnXkf0TY6yHSXRv8NS86FmUnFNzjk_pCIOLgrgfJbkxmZYFC66OdFLRA4PHOQ2UiyK6Br4eaixrZ-5NlYmO2AXCMbb_Qo66xtWpyddhdAMGxddxV67OHhRmLW9fy2wijnAPzU9Ur_Oi62eu23Z9lUdWg-uvkw7ldZA May 31 21:20:07.710365 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Domain-Id: None May 31 21:20:07.710365 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Domain-Name: None May 31 21:20:07.710365 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Identity-Status: Confirmed May 31 21:20:07.710365 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Is-Admin-Project: True May 31 21:20:07.710365 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Domain-Id: default May 31 21:20:07.710365 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Domain-Name: Default May 31 21:20:07.710365 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Id: 69b2364f40d14160adf0220d92adaad7 May 31 21:20:07.710365 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Name: tempest-AttachVolumeNegativeTest-14232740 May 31 21:20:07.710365 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Role: member,reader May 31 21:20:07.710365 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Roles: member,reader May 31 21:20:07.711880 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/69b2364f40d14160adf0220d92adaad7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/69b2364f40d14160adf0220d92adaad7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_69b2364f40d14160adf0220d92adaad7", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/69b2364f40d14160adf0220d92adaad7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] May 31 21:20:07.711880 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant: tempest-AttachVolumeNegativeTest-14232740 May 31 21:20:07.711880 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant-Id: 69b2364f40d14160adf0220d92adaad7 May 31 21:20:07.711880 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-14232740 May 31 21:20:07.711880 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User: tempest-AttachVolumeNegativeTest-14232740-project May 31 21:20:07.711880 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Domain-Id: default May 31 21:20:07.711880 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Domain-Name: Default May 31 21:20:07.711880 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Id: 8efe37a6d57b4775b4e47a295c3f5eee May 31 21:20:07.711880 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Name: tempest-AttachVolumeNegativeTest-14232740-project May 31 21:20:07.711880 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: method: > May 31 21:20:07.711880 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: exception: Instance 5cb669a7-8e63-46ac-86f6-1be4050a44ec could not be found. May 31 21:20:07.711880 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: action_args: {'id': '5cb669a7-8e63-46ac-86f6-1be4050a44ec'} May 31 21:20:07.712889 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 21:20:07.712889 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:20:07.712889 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 21:20:07.712889 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 21:20:07.712889 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 21:20:07.712889 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 21:20:07.712889 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 21:20:07.712889 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 21:20:07.712889 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 21:20:07.712889 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 21:20:07.712889 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cb669a7-8e63-46ac-86f6-1be4050a44ec could not be found. May 31 21:20:07.712889 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:20:07.712889 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:20:07.712889 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:20:07.712889 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:20:07.712889 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:20:07.712889 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:20:07.712889 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 21:20:07.712889 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 21:20:07.712889 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 21:20:07.714488 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 21:20:07.714488 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 31 21:20:07.714488 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 31 21:20:07.714488 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 31 21:20:07.714488 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 31 21:20:07.714488 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 21:20:07.714488 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 21:20:07.714488 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 21:20:07.714488 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 21:20:07.714488 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cb669a7-8e63-46ac-86f6-1be4050a44ec could not be found. May 31 21:20:07.714488 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:20:07.714488 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:20:07.714488 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:20:07.714488 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:20:07.714488 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:20:07.714488 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:20:07.714488 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 21:20:07.714488 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 21:20:07.714488 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cb669a7-8e63-46ac-86f6-1be4050a44ec could not be found. May 31 21:20:07.714488 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:20:07.716080 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-c584309e-1afd-4b46-9458-e2365cdfca3c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Returning 404 to user: Instance 5cb669a7-8e63-46ac-86f6-1be4050a44ec could not be found. {{(pid=118185) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 21:20:07.716080 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-c584309e-1afd-4b46-9458-e2365cdfca3c tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "DELETE /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec" status: 404 len: 111 microversion: 2.1 time: 0.029134 May 31 21:20:07.716080 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 622/1264] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 31 21:20:07 2022] DELETE /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 21:20:07.719868 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-cc7ab13a-8ec1-4caa-becd-36ec4606f59a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:20:07.720472 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-cc7ab13a-8ec1-4caa-becd-36ec4606f59a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] [instance: 5cb669a7-8e63-46ac-86f6-1be4050a44ec] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:20:07.727090 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-cc7ab13a-8ec1-4caa-becd-36ec4606f59a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:20:07.727529 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-cc7ab13a-8ec1-4caa-becd-36ec4606f59a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:20:07.728277 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-cc7ab13a-8ec1-4caa-becd-36ec4606f59a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:20:07.728706 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-cc7ab13a-8ec1-4caa-becd-36ec4606f59a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:20:07.741587 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.wsgi [None req-cc7ab13a-8ec1-4caa-becd-36ec4606f59a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] HTTP exception thrown: Instance 5cb669a7-8e63-46ac-86f6-1be4050a44ec could not be found. May 31 21:20:07.743659 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-cc7ab13a-8ec1-4caa-becd-36ec4606f59a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Request method failure captured: May 31 21:20:07.743659 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: request: GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec HTTP/1.1 May 31 21:20:07.743659 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Accept: application/json May 31 21:20:07.743659 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Accept-Encoding: identity May 31 21:20:07.743659 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Connection: close May 31 21:20:07.743659 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Content-Length: 0 May 31 21:20:07.743659 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Content-Type: application/json May 31 21:20:07.743659 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Host: 10.222.0.55 May 31 21:20:07.743659 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Openstack-System-Scope: None May 31 21:20:07.743659 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: User-Agent: python-urllib3/1.26.9 May 31 21:20:07.743659 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Auth-Token: gAAAAABiloR6qg65df265xnXkf0TY6yHSXRv8NS86FmUnFNzjk_pCIOLgrgfJbkxmZYFC66OdFLRA4PHOQ2UiyK6Br4eaixrZ-5NlYmO2AXCMbb_Qo66xtWpyddhdAMGxddxV67OHhRmLW9fy2wijnAPzU9Ur_Oi62eu23Z9lUdWg-uvkw7ldZA May 31 21:20:07.743659 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Domain-Id: None May 31 21:20:07.743659 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Domain-Name: None May 31 21:20:07.743659 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Identity-Status: Confirmed May 31 21:20:07.743659 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Is-Admin-Project: True May 31 21:20:07.743659 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Domain-Id: default May 31 21:20:07.743659 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Domain-Name: Default May 31 21:20:07.743659 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Id: 69b2364f40d14160adf0220d92adaad7 May 31 21:20:07.743659 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Project-Name: tempest-AttachVolumeNegativeTest-14232740 May 31 21:20:07.743659 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Role: member,reader May 31 21:20:07.743659 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Roles: member,reader May 31 21:20:07.745292 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/69b2364f40d14160adf0220d92adaad7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/69b2364f40d14160adf0220d92adaad7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_69b2364f40d14160adf0220d92adaad7", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/69b2364f40d14160adf0220d92adaad7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] May 31 21:20:07.745292 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant: tempest-AttachVolumeNegativeTest-14232740 May 31 21:20:07.745292 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant-Id: 69b2364f40d14160adf0220d92adaad7 May 31 21:20:07.745292 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-14232740 May 31 21:20:07.745292 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User: tempest-AttachVolumeNegativeTest-14232740-project May 31 21:20:07.745292 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Domain-Id: default May 31 21:20:07.745292 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Domain-Name: Default May 31 21:20:07.745292 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Id: 8efe37a6d57b4775b4e47a295c3f5eee May 31 21:20:07.745292 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: X-User-Name: tempest-AttachVolumeNegativeTest-14232740-project May 31 21:20:07.745292 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: method: > May 31 21:20:07.745292 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: exception: Instance 5cb669a7-8e63-46ac-86f6-1be4050a44ec could not be found. May 31 21:20:07.745292 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: action_args: {'id': '5cb669a7-8e63-46ac-86f6-1be4050a44ec'} May 31 21:20:07.746315 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 21:20:07.746315 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:20:07.746315 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 21:20:07.746315 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 21:20:07.746315 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 21:20:07.746315 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 21:20:07.746315 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 21:20:07.746315 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 21:20:07.746315 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 21:20:07.746315 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 21:20:07.746315 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cb669a7-8e63-46ac-86f6-1be4050a44ec could not be found. May 31 21:20:07.746315 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:20:07.746315 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:20:07.746315 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:20:07.746315 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:20:07.746315 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:20:07.746315 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:20:07.746315 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 21:20:07.746315 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 21:20:07.746315 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 21:20:07.747597 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 21:20:07.747597 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 21:20:07.747597 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 21:20:07.747597 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 21:20:07.747597 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 21:20:07.747597 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 21:20:07.747597 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 21:20:07.747597 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cb669a7-8e63-46ac-86f6-1be4050a44ec could not be found. May 31 21:20:07.747597 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:20:07.747597 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:20:07.747597 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:20:07.747597 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:20:07.747597 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:20:07.747597 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:20:07.747597 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 21:20:07.747597 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 21:20:07.747597 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cb669a7-8e63-46ac-86f6-1be4050a44ec could not be found. May 31 21:20:07.747597 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: ERROR nova.api.openstack.wsgi May 31 21:20:07.748837 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-cc7ab13a-8ec1-4caa-becd-36ec4606f59a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] Returning 404 to user: Instance 5cb669a7-8e63-46ac-86f6-1be4050a44ec could not be found. {{(pid=118184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 21:20:07.748837 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-cc7ab13a-8ec1-4caa-becd-36ec4606f59a tempest-AttachVolumeNegativeTest-14232740 tempest-AttachVolumeNegativeTest-14232740-project] 10.222.0.55 "GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec" status: 404 len: 111 microversion: 2.1 time: 0.028914 May 31 21:20:07.748837 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 643/1265] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:20:07 2022] GET /compute/v2.1/servers/5cb669a7-8e63-46ac-86f6-1be4050a44ec => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 31 21:20:14.713884 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-6765c097-9151-4c79-be6f-b8d0bf3f7c3d tempest-VolumesTestJSON-1312442706 tempest-VolumesTestJSON-1312442706-project] Calling method '.version_select at 0x7fe7c0ccc1f0>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:20:14.760328 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-6765c097-9151-4c79-be6f-b8d0bf3f7c3d tempest-VolumesTestJSON-1312442706 tempest-VolumesTestJSON-1312442706-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/4068f5a1-5d47-4457-be98-9848f5ef156d" status: 200 len: 351 microversion: 2.1 time: 0.050880 May 31 21:20:14.760886 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 623/1266] 10.222.0.55 () {58 vars in 1244 bytes} [Tue May 31 21:20:14 2022] GET /compute/v2.1/os-volumes/4068f5a1-5d47-4457-be98-9848f5ef156d => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:20:16.343031 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-81b2d563-373a-4c5c-a428-46b52a78819b tempest-VolumesTestJSON-1312442706 tempest-VolumesTestJSON-1312442706-project] Calling method '.version_select at 0x7fe7c0b9f670>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:20:16.389235 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-81b2d563-373a-4c5c-a428-46b52a78819b tempest-VolumesTestJSON-1312442706 tempest-VolumesTestJSON-1312442706-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/da171559-3577-45fb-a53a-c7a04ca9bce3" status: 200 len: 350 microversion: 2.1 time: 0.049864 May 31 21:20:16.389921 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 644/1267] 10.222.0.55 () {58 vars in 1244 bytes} [Tue May 31 21:20:16 2022] GET /compute/v2.1/os-volumes/da171559-3577-45fb-a53a-c7a04ca9bce3 => generated 350 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:20:17.966702 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_api:SELECT=20 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:20:17.970717 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG dbcounter [-] [118185] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=118185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:20:17.971339 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-5879fc4e-9cbc-41d9-988d-2a503d418209 tempest-VolumesTestJSON-1312442706 tempest-VolumesTestJSON-1312442706-project] Calling method '.version_select at 0x7fe7c5e51700>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:20:18.018089 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-5879fc4e-9cbc-41d9-988d-2a503d418209 tempest-VolumesTestJSON-1312442706 tempest-VolumesTestJSON-1312442706-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/3a7969bd-30da-4b06-ac1e-8968739b322d" status: 200 len: 349 microversion: 2.1 time: 0.052696 May 31 21:20:18.018660 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 624/1268] 10.222.0.55 () {58 vars in 1244 bytes} [Tue May 31 21:20:17 2022] GET /compute/v2.1/os-volumes/3a7969bd-30da-4b06-ac1e-8968739b322d => generated 349 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:20:18.027602 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:20:18.030039 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG dbcounter [-] [118184] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:20:18.032205 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-880ebc0d-12f3-4aeb-a5e2-a9764e9ce605 tempest-VolumesTestJSON-1312442706 tempest-VolumesTestJSON-1312442706-project] Calling method '.version_select at 0x7fe7c5edc430>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:20:18.113983 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-880ebc0d-12f3-4aeb-a5e2-a9764e9ce605 tempest-VolumesTestJSON-1312442706 tempest-VolumesTestJSON-1312442706-project] 10.222.0.55 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.086107 May 31 21:20:18.113983 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 645/1269] 10.222.0.55 () {58 vars in 1133 bytes} [Tue May 31 21:20:18 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:20:18.125715 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-a0b497bd-9dbb-4f88-9c79-2959127b44ba tempest-VolumesTestJSON-1312442706 tempest-VolumesTestJSON-1312442706-project] Calling method '.version_select at 0x7fe7c5fa5430>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:20:18.205070 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-a0b497bd-9dbb-4f88-9c79-2959127b44ba tempest-VolumesTestJSON-1312442706 tempest-VolumesTestJSON-1312442706-project] 10.222.0.55 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.083704 May 31 21:20:18.205643 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 625/1270] 10.222.0.55 () {58 vars in 1148 bytes} [Tue May 31 21:20:18 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 692 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:20:18.218038 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-3abfc643-29b0-4157-810e-334a42c32fe8 tempest-VolumesTestJSON-1312442706 tempest-VolumesTestJSON-1312442706-project] Calling method '.version_select at 0x7fe7c5fa63a0>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:20:18.479162 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-3abfc643-29b0-4157-810e-334a42c32fe8 tempest-VolumesTestJSON-1312442706 tempest-VolumesTestJSON-1312442706-project] 10.222.0.55 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.265194 May 31 21:20:18.479736 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 646/1271] 10.222.0.55 () {58 vars in 1133 bytes} [Tue May 31 21:20:18 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:20:18.491012 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-a26e2f16-151d-4c0b-bc75-f1c87a8c67ef tempest-VolumesTestJSON-1312442706 tempest-VolumesTestJSON-1312442706-project] Calling method '.version_select at 0x7fe7c0ccc0d0>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:20:18.570705 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-a26e2f16-151d-4c0b-bc75-f1c87a8c67ef tempest-VolumesTestJSON-1312442706 tempest-VolumesTestJSON-1312442706-project] 10.222.0.55 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.083734 May 31 21:20:18.575404 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 626/1272] 10.222.0.55 () {58 vars in 1166 bytes} [Tue May 31 21:20:18 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:20:18.583134 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-28cb5782-a197-4475-be3f-5ec8325231ab tempest-VolumesTestJSON-1312442706 tempest-VolumesTestJSON-1312442706-project] Calling method '.version_select at 0x7fe7c5fad820>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:20:18.662800 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-28cb5782-a197-4475-be3f-5ec8325231ab tempest-VolumesTestJSON-1312442706 tempest-VolumesTestJSON-1312442706-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.083338 May 31 21:20:18.663361 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 647/1273] 10.222.0.55 () {58 vars in 1169 bytes} [Tue May 31 21:20:18 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 692 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:20:18.675133 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-29e3ec5a-bd6d-4e78-ac4f-c46be622cd73 tempest-VolumesTestJSON-1312442706 tempest-VolumesTestJSON-1312442706-project] Calling method '.version_select at 0x7fe7c5e661f0>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:20:18.754651 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-29e3ec5a-bd6d-4e78-ac4f-c46be622cd73 tempest-VolumesTestJSON-1312442706 tempest-VolumesTestJSON-1312442706-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.083204 May 31 21:20:18.755224 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 627/1274] 10.222.0.55 () {58 vars in 1154 bytes} [Tue May 31 21:20:18 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:20:18.766766 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-b0a7ca07-7676-4dd5-adf9-46277641a65d tempest-VolumesTestJSON-1312442706 tempest-VolumesTestJSON-1312442706-project] Calling method '.version_select at 0x7fe7c5edcca0>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:20:18.848099 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-b0a7ca07-7676-4dd5-adf9-46277641a65d tempest-VolumesTestJSON-1312442706 tempest-VolumesTestJSON-1312442706-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.084972 May 31 21:20:18.848726 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 648/1275] 10.222.0.55 () {58 vars in 1187 bytes} [Tue May 31 21:20:18 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 21:20:18.860036 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-1fe3ad6c-e431-42f0-b1d7-e3b072fb0b3e tempest-VolumesTestJSON-1312442706 tempest-VolumesTestJSON-1312442706-project] Calling method '.version_select at 0x7fe7c5e51ca0>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:20:18.942196 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-1fe3ad6c-e431-42f0-b1d7-e3b072fb0b3e tempest-VolumesTestJSON-1312442706 tempest-VolumesTestJSON-1312442706-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.085766 May 31 21:20:18.942770 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 628/1276] 10.222.0.55 () {58 vars in 1154 bytes} [Tue May 31 21:20:18 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:20:23.705777 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 21:20:23.712099 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Tue May 31 21:20:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 21:21:14.862465 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-2f57153c-2dbf-417b-a133-e69ade34cb4c tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:21:14.862465 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-2f57153c-2dbf-417b-a133-e69ade34cb4c tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] [instance: 45453898-e1e4-44bb-8af5-3a1729aa2870] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:21:14.862465 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2f57153c-2dbf-417b-a133-e69ade34cb4c tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:21:14.862465 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2f57153c-2dbf-417b-a133-e69ade34cb4c tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:21:14.863895 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2f57153c-2dbf-417b-a133-e69ade34cb4c tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:21:14.863895 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-2f57153c-2dbf-417b-a133-e69ade34cb4c tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:21:14.890952 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-2f57153c-2dbf-417b-a133-e69ade34cb4c tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] [instance: 45453898-e1e4-44bb-8af5-3a1729aa2870] Going to try to terminate instance {{(pid=118184) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 21:21:14.993183 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [req-6403731d-fd55-43eb-b01c-84e209c5390f req-19a6084c-b81e-471e-938b-b0febc467f5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45453898-e1e4-44bb-8af5-3a1729aa2870", "tag": "6278ba73-77b2-4be4-a1a0-b7b239769dc3"}]} {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:21:15.003670 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-6403731d-fd55-43eb-b01c-84e209c5390f req-19a6084c-b81e-471e-938b-b0febc467f5b service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:21:15.004117 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [req-6403731d-fd55-43eb-b01c-84e209c5390f req-19a6084c-b81e-471e-938b-b0febc467f5b service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:21:15.015362 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.compute.server_external_events [req-6403731d-fd55-43eb-b01c-84e209c5390f req-19a6084c-b81e-471e-938b-b0febc467f5b service nova] Creating event network-changed:6278ba73-77b2-4be4-a1a0-b7b239769dc3 for instance 45453898-e1e4-44bb-8af5-3a1729aa2870 on hv-cinder-83979 May 31 21:21:15.021610 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [req-6403731d-fd55-43eb-b01c-84e209c5390f req-19a6084c-b81e-471e-938b-b0febc467f5b service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.170352 May 31 21:21:15.022470 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 629/1277] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:21:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 21:21:15.159377 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-2f57153c-2dbf-417b-a133-e69ade34cb4c tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] 10.222.0.55 "DELETE /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870" status: 204 len: 0 microversion: 2.1 time: 0.309574 May 31 21:21:15.159964 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 649/1278] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 31 21:21:14 2022] DELETE /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 31 21:21:15.169560 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-365f5bc3-9d66-4add-a990-4534b0251cf3 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:21:15.170322 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-365f5bc3-9d66-4add-a990-4534b0251cf3 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] [instance: 45453898-e1e4-44bb-8af5-3a1729aa2870] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:21:15.177671 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-365f5bc3-9d66-4add-a990-4534b0251cf3 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:21:15.178529 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-365f5bc3-9d66-4add-a990-4534b0251cf3 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:21:15.179377 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-365f5bc3-9d66-4add-a990-4534b0251cf3 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:21:15.180078 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-365f5bc3-9d66-4add-a990-4534b0251cf3 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:21:15.339891 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-365f5bc3-9d66-4add-a990-4534b0251cf3 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782845f8e6a440b684ae46a6ed118a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c46b1e7a32484b9c22387f2aaeb871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:21:15.348303 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-365f5bc3-9d66-4add-a990-4534b0251cf3 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] 10.222.0.55 "GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870" status: 200 len: 1570 microversion: 2.1 time: 0.183482 May 31 21:21:15.349203 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 630/1279] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:21:15 2022] GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870 => generated 1570 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:21:16.366652 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-d9775b8a-b91c-455c-b838-57706096cd35 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:21:16.367354 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-d9775b8a-b91c-455c-b838-57706096cd35 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] [instance: 45453898-e1e4-44bb-8af5-3a1729aa2870] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:21:16.374024 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d9775b8a-b91c-455c-b838-57706096cd35 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:21:16.374548 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d9775b8a-b91c-455c-b838-57706096cd35 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:21:16.375382 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d9775b8a-b91c-455c-b838-57706096cd35 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:21:16.375915 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-d9775b8a-b91c-455c-b838-57706096cd35 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:21:16.507270 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-d9775b8a-b91c-455c-b838-57706096cd35 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782845f8e6a440b684ae46a6ed118a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c46b1e7a32484b9c22387f2aaeb871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:21:16.527621 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-d9775b8a-b91c-455c-b838-57706096cd35 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] 10.222.0.55 "GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870" status: 200 len: 1570 microversion: 2.1 time: 0.165624 May 31 21:21:16.532261 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 650/1280] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:21:16 2022] GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870 => generated 1570 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:21:17.545569 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-f5f76476-3684-4de5-9cd6-d626ad8b5750 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:21:17.546197 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-f5f76476-3684-4de5-9cd6-d626ad8b5750 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] [instance: 45453898-e1e4-44bb-8af5-3a1729aa2870] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:21:17.555401 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f5f76476-3684-4de5-9cd6-d626ad8b5750 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:21:17.555813 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f5f76476-3684-4de5-9cd6-d626ad8b5750 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:21:17.556596 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f5f76476-3684-4de5-9cd6-d626ad8b5750 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:21:17.557006 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-f5f76476-3684-4de5-9cd6-d626ad8b5750 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:21:17.607033 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [req-2b1af590-409f-45fe-b631-774b8ef1dd86 req-d43d51d1-c47d-4db8-8ba2-9da45682d786 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45453898-e1e4-44bb-8af5-3a1729aa2870", "name": "network-vif-deleted", "tag": "6278ba73-77b2-4be4-a1a0-b7b239769dc3"}]} {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 21:21:17.615613 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-2b1af590-409f-45fe-b631-774b8ef1dd86 req-d43d51d1-c47d-4db8-8ba2-9da45682d786 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:21:17.616046 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [req-2b1af590-409f-45fe-b631-774b8ef1dd86 req-d43d51d1-c47d-4db8-8ba2-9da45682d786 service nova] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:21:17.626773 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.compute.server_external_events [req-2b1af590-409f-45fe-b631-774b8ef1dd86 req-d43d51d1-c47d-4db8-8ba2-9da45682d786 service nova] Creating event network-vif-deleted:6278ba73-77b2-4be4-a1a0-b7b239769dc3 for instance 45453898-e1e4-44bb-8af5-3a1729aa2870 on hv-cinder-83979 May 31 21:21:17.630956 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.policy [None req-f5f76476-3684-4de5-9cd6-d626ad8b5750 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782845f8e6a440b684ae46a6ed118a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c46b1e7a32484b9c22387f2aaeb871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118185) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:21:17.632461 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [req-2b1af590-409f-45fe-b631-774b8ef1dd86 req-d43d51d1-c47d-4db8-8ba2-9da45682d786 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029327 May 31 21:21:17.633114 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 651/1281] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 31 21:21:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 21:21:17.639138 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-f5f76476-3684-4de5-9cd6-d626ad8b5750 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] 10.222.0.55 "GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870" status: 200 len: 1384 microversion: 2.1 time: 0.097514 May 31 21:21:17.639705 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 631/1282] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:21:17 2022] GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870 => generated 1384 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:21:18.657047 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-c252a5eb-bee9-4e67-818f-9c4c576ab937 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Calling method '>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:21:18.657742 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.compute.api [None req-c252a5eb-bee9-4e67-818f-9c4c576ab937 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] [instance: 45453898-e1e4-44bb-8af5-3a1729aa2870] Fetching instance by UUID {{(pid=118184) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:21:18.665141 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c252a5eb-bee9-4e67-818f-9c4c576ab937 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:21:18.665730 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c252a5eb-bee9-4e67-818f-9c4c576ab937 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:21:18.666655 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c252a5eb-bee9-4e67-818f-9c4c576ab937 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:21:18.667084 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c252a5eb-bee9-4e67-818f-9c4c576ab937 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:21:18.701535 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c252a5eb-bee9-4e67-818f-9c4c576ab937 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:21:18.702088 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG oslo_concurrency.lockutils [None req-c252a5eb-bee9-4e67-818f-9c4c576ab937 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:21:18.702545 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.objects.instance [None req-c252a5eb-bee9-4e67-818f-9c4c576ab937 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lazy-loading 'fault' on Instance uuid 45453898-e1e4-44bb-8af5-3a1729aa2870 {{(pid=118184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 21:21:18.745123 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.policy [None req-c252a5eb-bee9-4e67-818f-9c4c576ab937 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782845f8e6a440b684ae46a6ed118a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c46b1e7a32484b9c22387f2aaeb871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118184) authorize /opt/stack/nova/nova/policy.py:199}} May 31 21:21:18.753304 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-c252a5eb-bee9-4e67-818f-9c4c576ab937 tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] 10.222.0.55 "GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870" status: 200 len: 1225 microversion: 2.1 time: 0.100451 May 31 21:21:18.753863 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 652/1283] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:21:18 2022] GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870 => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 21:21:19.770707 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-07ea5411-e5ca-4a6d-a896-65c80d93a77e tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Calling method '>' {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:21:19.771340 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.compute.api [None req-07ea5411-e5ca-4a6d-a896-65c80d93a77e tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] [instance: 45453898-e1e4-44bb-8af5-3a1729aa2870] Fetching instance by UUID {{(pid=118185) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 21:21:19.777432 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-07ea5411-e5ca-4a6d-a896-65c80d93a77e tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:21:19.777881 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-07ea5411-e5ca-4a6d-a896-65c80d93a77e tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:21:19.778670 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-07ea5411-e5ca-4a6d-a896-65c80d93a77e tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 21:21:19.779106 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG oslo_concurrency.lockutils [None req-07ea5411-e5ca-4a6d-a896-65c80d93a77e tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Lock "cc5ba698-8981-4abe-a800-db6251f99fd3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 21:21:19.792834 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.wsgi [None req-07ea5411-e5ca-4a6d-a896-65c80d93a77e tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] HTTP exception thrown: Instance 45453898-e1e4-44bb-8af5-3a1729aa2870 could not be found. May 31 21:21:19.794533 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-07ea5411-e5ca-4a6d-a896-65c80d93a77e tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Request method failure captured: May 31 21:21:19.794533 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: request: GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870 HTTP/1.1 May 31 21:21:19.794533 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Accept: application/json May 31 21:21:19.794533 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Accept-Encoding: identity May 31 21:21:19.794533 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Connection: close May 31 21:21:19.794533 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Content-Length: 0 May 31 21:21:19.794533 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Content-Type: application/json May 31 21:21:19.794533 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Host: 10.222.0.55 May 31 21:21:19.794533 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Openstack-System-Scope: None May 31 21:21:19.794533 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: User-Agent: python-urllib3/1.26.9 May 31 21:21:19.794533 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Auth-Token: gAAAAABiloU_1guEA4nCMxRCDHnMGoRBTW4uYF8aCe4nvgjAs0Ifc6NogX3m5Ub08o9DRooonPOON5K2IeNjqBfc7h1oQ9SoNwANhRlv2frPfulKH1jfepK7G1WcTtMbgLRXlYAWrE75de53pIn5_f0uhgmFu3mbLBneFoSJp2txDbQ1zsVgaAk May 31 21:21:19.794533 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Domain-Id: None May 31 21:21:19.794533 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Domain-Name: None May 31 21:21:19.794533 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Identity-Status: Confirmed May 31 21:21:19.794533 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Is-Admin-Project: True May 31 21:21:19.794533 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Domain-Id: default May 31 21:21:19.794533 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Domain-Name: Default May 31 21:21:19.794533 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Id: d9c46b1e7a32484b9c22387f2aaeb871 May 31 21:21:19.794533 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Project-Name: tempest-TestShelveInstance-853675695 May 31 21:21:19.794533 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Role: member,reader May 31 21:21:19.794533 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Roles: member,reader May 31 21:21:19.796355 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/d9c46b1e7a32484b9c22387f2aaeb871"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d9c46b1e7a32484b9c22387f2aaeb871"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_d9c46b1e7a32484b9c22387f2aaeb871", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d9c46b1e7a32484b9c22387f2aaeb871"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}] May 31 21:21:19.796355 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant: tempest-TestShelveInstance-853675695 May 31 21:21:19.796355 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant-Id: d9c46b1e7a32484b9c22387f2aaeb871 May 31 21:21:19.796355 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-Tenant-Name: tempest-TestShelveInstance-853675695 May 31 21:21:19.796355 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User: tempest-TestShelveInstance-853675695-project May 31 21:21:19.796355 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Domain-Id: default May 31 21:21:19.796355 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Domain-Name: Default May 31 21:21:19.796355 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Id: 782845f8e6a440b684ae46a6ed118a62 May 31 21:21:19.796355 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: X-User-Name: tempest-TestShelveInstance-853675695-project May 31 21:21:19.796355 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: method: > May 31 21:21:19.796355 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: exception: Instance 45453898-e1e4-44bb-8af5-3a1729aa2870 could not be found. May 31 21:21:19.796355 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: action_args: {'id': '45453898-e1e4-44bb-8af5-3a1729aa2870'} May 31 21:21:19.798176 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: {{(pid=118185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 21:21:19.798176 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:21:19.798176 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 21:21:19.798176 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 21:21:19.798176 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 21:21:19.798176 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 21:21:19.798176 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 21:21:19.798176 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 21:21:19.798176 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 21:21:19.798176 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 21:21:19.798176 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45453898-e1e4-44bb-8af5-3a1729aa2870 could not be found. May 31 21:21:19.798176 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:21:19.798176 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:21:19.798176 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:21:19.798176 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:21:19.798176 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:21:19.798176 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:21:19.798176 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 21:21:19.798176 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 21:21:19.798176 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 21:21:19.799963 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 21:21:19.799963 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 21:21:19.799963 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 21:21:19.799963 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 21:21:19.799963 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 21:21:19.799963 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 21:21:19.799963 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 21:21:19.799963 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45453898-e1e4-44bb-8af5-3a1729aa2870 could not be found. May 31 21:21:19.799963 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:21:19.799963 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 21:21:19.799963 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:21:19.799963 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 21:21:19.799963 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 21:21:19.799963 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 21:21:19.799963 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 21:21:19.799963 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 21:21:19.799963 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45453898-e1e4-44bb-8af5-3a1729aa2870 could not be found. May 31 21:21:19.799963 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: ERROR nova.api.openstack.wsgi May 31 21:21:19.802022 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: DEBUG nova.api.openstack.wsgi [None req-07ea5411-e5ca-4a6d-a896-65c80d93a77e tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Returning 404 to user: Instance 45453898-e1e4-44bb-8af5-3a1729aa2870 could not be found. {{(pid=118185) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 21:21:19.802022 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO nova.api.openstack.requestlog [None req-07ea5411-e5ca-4a6d-a896-65c80d93a77e tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] 10.222.0.55 "GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870" status: 404 len: 111 microversion: 2.1 time: 0.029679 May 31 21:21:19.802022 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: [pid: 118185|app: 0|req: 632/1284] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 31 21:21:19 2022] GET /compute/v2.1/servers/45453898-e1e4-44bb-8af5-3a1729aa2870 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 21:21:20.036588 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: DEBUG nova.api.openstack.wsgi [None req-bbfc88f0-1e5d-491c-a4e9-0c3b084f370c tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] Calling method '.version_select at 0x7fe7c5edca60>' {{(pid=118184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 21:21:20.112088 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO nova.api.openstack.requestlog [None req-bbfc88f0-1e5d-491c-a4e9-0c3b084f370c tempest-TestShelveInstance-853675695 tempest-TestShelveInstance-853675695-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1124702584" status: 202 len: 0 microversion: 2.1 time: 0.079204 May 31 21:21:20.112660 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: [pid: 118184|app: 0|req: 653/1285] 10.222.0.55 () {58 vars in 1253 bytes} [Tue May 31 21:21:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1124702584 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 21:21:41.932536 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 21:21:41.933052 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Tue May 31 21:21:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 21:23:34.381443 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 21:23:34.382034 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Tue May 31 21:23:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 21:23:37.573337 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 21:23:37.573946 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Tue May 31 21:23:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 21:23:42.311259 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 21:23:42.312125 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Tue May 31 21:23:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 21:23:43.714139 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 21:23:43.714699 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Tue May 31 21:23:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 21:23:58.643208 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 21:23:58.643805 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Tue May 31 21:23:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 21:25:01.940004 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 21:25:01.940526 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Tue May 31 21:25:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 21:26:54.389480 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 21:26:54.390049 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Tue May 31 21:26:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 21:26:57.581581 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 21:26:57.582218 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Tue May 31 21:26:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 21:27:02.319465 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 21:27:02.320023 dv-cinder-839793-16-iscsi devstack@n-api.service[118185]: Tue May 31 21:27:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 21:27:03.721900 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 21:27:03.722646 dv-cinder-839793-16-iscsi devstack@n-api.service[118184]: Tue May 31 21:27:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!